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ABSTRACT 


The  purpose  of  this  researeh  was  to  determine  if  a  spatialized  headphone  display 
would  improve  users’  reeognition  accuracy  when  listening  to  more  than  two  overlapping 
messages.  This  type  of  task  has  numerous  applications  in  a  variety  of  different  military 
settings,  such  as  aviation  communications  and  combat  information  centers. 

Two  experiments  were  conducted  in  the  Advanced  Auditory  Displays  Laboratory 
at  the  Naval  Postgraduate  School.  The  first  experiment  was  a  pilot  study,  which  was 
designed  to  identify  the  factors  that  contributed  to  changes  in  response  accuracy  rates. 
The  conclusion  of  this  effort  was  a  decision  to  use  a  chi-squared  analysis  and  a 
multivariate  logit  regression,  which  could  examine  the  influence  of  several  factors  in 
addition  to  spatialization. 

Results  indicated  that  participants  accurately  identified  43%  of  the  messages  in 
the  spatialized  condition,  but  only  17%  of  the  messages  in  the  non-spatialized  condition. 
Chi-squared  tests  indicated  a  dependent  relationship  between  accuracy  and  spatialization 
under  a  variety  of  conditions.  The  logit  regression  model  confirmed  these  conclusions 
and  indicated  that  the  chance  of  a  completely  correct  response  was  improved  by 
approximately  30%  with  the  use  of  spatialization. 
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EXECUTIVE  SUMMARY 


The  purpose  of  this  researeh  was  to  determine  if  a  spatialized  headphone  display 
would  increase  speech  comprehension  when  listening  to  multiple  simultaneously 
presented  messages.  The  design  was  intended  to  simulate  a  multi-channel  radio 
communication  task.  There  are  numerous  military  applications  that  could  potentially  be 
improved  by  this  type  of  display.  Possible  settings  range  from  aviation  communications 
to  shipboard  combat  information  centers. 

Prior  research  has  demonstrated  the  benefit  of  spatially  separating  competing 
message  sources,  but  these  experiments  have  generally  been  limited  to  two  audio  sources 
and  used  multiple  loudspeakers  instead  of  spatialized  audio  over  headphones.  One  of  the 
objectives  of  this  research  was  to  determine  if  these  results  could  be  extended  to  a 
scenario  that  used  up  to  four  overlapping  messages  with  a  headphone  display. 

Two  experiments  were  conducted  in  the  Advanced  Auditory  Displays  Laboratory 
at  the  Naval  Postgraduate  School.  These  studies  utilized  36  participants.  The  first 
experiment  was  a  pilot  study,  which  was  designed  to  identify  the  factors  that  contributed 
to  changes  in  response  accuracy.  The  conclusion  of  this  effort  was  a  decision  to  use  a 
combination  of  chi-squared  tests  for  independence  and  multivariate  logit  regression  to 
examine  the  influence  of  several  factors,  with  a  focus  on  the  effect  of  spatialization 

Results  from  the  final  experiment  indicated  that  17%  of  participant  responses 
were  completely  correct  without  spatialization  versus  43%  with  spatialization.  The  chi- 
squared  tests  indicated  a  dependent  relationship  between  accuracy  and  spatialization 
under  a  variety  of  conditions.  The  logit  regression  model  confirmed  these  conclusions 
and  indicated  that  the  chance  of  a  completely  correct  response  was  improved  by  roughly 
30%  with  the  use  of  spatialization. 
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I.  INTRODUCTION 


A,  BACKGROUND 


Military  operational  environments  routinely  require  personnel  to  attend  to 
multiple  sources  of  information.  Often  this  information  is  delivered  through  headphones 
or  loudspeakers.  This  is  most  frequently  the  case  when  there  is  a  need  for  real-time 
speech  communications.  In  the  Navy,  there  are  a  variety  of  functions  that  specifically 
require  the  use  of  headphone  or  earpiece  communications.  Some  examples  include  pilots, 
air  traffic  controllers,  flight  deck  personnel,  tactical  action  officers,  and  fire  control 
teams.  Often,  there  is  an  additional  requirement  to  monitor  multiple  channels  or 
networks  at  one  time.  For  these  types  of  tasks,  difficulties  arise  when  there  is  a  need  to 
attend  to  two  or  more  messages  simultaneously. 

Switching  between  networks  raises  the  possibility  that  information  could  be  lost 
in  a  busy,  overloaded  environment.  Adding  multiple  message  sources  to  each  channel 
reduces  the  number  of  switches  that  are  required,  but  it  presents  a  new  obstacle  in  the 
form  of  message  intelligibility.  One  solution  to  this  problem  is  to  separate  the  messages 
spatially,  so  that  they  are  not  perceptually  localized  at  the  same  point  in  space.  In  the 
most  basic  configuration,  one  message  can  be  sent  to  the  left  ear,  while  another  is  sent  to 
the  right  (diotic  presentation).  The  result  may  not  meet  the  ideal  of  listening  to  a  single 
speaker  at  a  time,  but  is  preferable  to  messages  that  are  not  spatially  separated  (monotic 
presentation).  The  limitation  to  this  technique  is  obvious.  Adding  more  than  two 
messages  results  in  the  same  overlapping  babble  that  existed  before  the  separation. 

Advances  in  modern  audio  technology  offer  a  potential  solution  to  this  dilemma. 
It  is  now  possible  to  synthesize  spatial  auditory  cues  over  headphones.  This  means  that  a 
three  dimensional  listening  environment  can  be  generated  without  the  use  of  prohibitively 
large  and  expensive  loudspeaker  configurations.  The  significance  of  this  capability  is 
that  a  listener  could  simultaneously  perceive  more  than  two  messages  that  are  spatially 
separated.  The  headphone  listener  would  perceive  each  sound  source  as  if  it  were  located 
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in  a  different  point  in  space,  a  situation  that  is  comparable  to  a  person  who  is  trying  to 
follow  a  single  conversation  in  a  crowded  room. 

The  question,  however,  is  whether  spatial  audio  presented  over  headphones  is 
really  analogous  to  a  room  full  of  people.  Clearly  there  are  differences.  One  such 
difference  is  the  lack  of  visual  cues.  Facial  expressions,  especially  lip  and  mouth 
movement,  are  good  examples  of  visual  stimuli  that  help  a  listener  to  understand  speech. 
Despite  the  differences,  there  are  anecdotal  reasons  to  believe  that  the  separation  of 
sounds  offers  an  advantage  over  a  cacophony  that  seems  to  originate  from  one  location. 

Research  dating  back  to  the  mid  1940s  and  50s  provides  empirical  evidence  that 
there  are  advantages  to  using  binaural  displays  that  spatially  separate  messages  between 
the  ears.  These  types  of  systems  are  already  in  use,  but  the  headphone  component  is 
always  limited  to  two  messages,  one  for  each  ear.  More  recent  studies  have  gone  further 
to  demonstrate  the  benefits  of  sophisticated  headphone  displays,  but  they  have  also  been 
limited  to  the  study  of  either  two  competing  messages,  or  a  message  and  noise.  i  This  is 
unfortunate  for  two  reasons.  First,  they  do  not  fully  test  the  advantage  of  a  3-D  auditory 
environment  because  they  maintain  the  two-source  limitation.  The  angle  of  separation  in 
the  older  binaural  displays  may  not  be  optimal  for  maximizing  word  intelligibility,  but  a 
spatial  auditory  environment  with  only  two  sound  sources  does  not  significantly  reduce 
the  burden  of  managing  multiple  communication  networks.  Finally,  these  experiments 
beg  the  question  of  whether  the  benefits  of  spatial  audio  persist  when  more  sound  sources 
are  added? 

B.  RESEARCH  OBJECTIVE 


The  primary  purpose  of  this  research  is  to  examine  the  benefit  of  spatial  auditory 
displays  for  speech  communications.  More  specifically,  it  focuses  on  whether 
spatialization  provides  an  advantage  when  a  listener  is  forced  to  attend  to  more  than  one 
message  at  a  time.  This  question  is  explored  in  two  ways.  First,  a  review  of  previous 
experiments  is  presented  as  general  background  and  to  establish  that  some  researchers 

1  Details  are  included  in  Chapter  2,  sections  B.2  and  B.3. 
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have  found  an  advantage  to  separating  two  competing  messages.  Second,  a  description  of 
two  new  experiments  is  provided  along  with  an  analysis  of  data  collected  in  the 
Advanced  Auditory  Displays  Laboratory  at  the  Naval  Postgraduate  School.  These 
studies  were  significant  because  they  made  use  of  trials  with  two,  three,  and  four 
overlapping  messages. 

A  secondary  objective  of  this  research  is  to  lay  the  groundwork  for  future  study. 
The  protocols  and  procedures  used  in  the  experimental  portion  may  be  useful  for  related 
thesis  work  in  verbal  communications.  In  addition,  the  analysis  of  results  could 
potentially  lead  to  new  hypotheses  and  testing. 

Ultimately,  the  objective  of  all  research  in  this  area  is  to  improve  the  productivity 
and  safety  of  the  military  working  environment  by  using  new  technology  to  improve 
auditory  displays. 


C.  SCOPE  AND  LIMITATIONS 


Much  of  this  research,  particularly  the  experimental  portion,  is  intended  to  apply 
to  generic  verbal  communications.  The  objective  is  to  simulate  a  scenario  that  is  relevant 
to  the  armed  forces,  but  the  subject  matter  is  not  limited  to  a  specific  military  function  or 
application.  For  example,  participants  were  asked  to  listen  for  a  call  sign  and  answer  a 
question  regarding  message  content.  The  messages  were  framed  to  give  the  general 
impression  of  a  military  setting,  but  the  actual  function  being  performed  was  ambiguous. 
The  participants  were  never  told  that  they  were  flying  a  helicopter,  leading  an  infantry 
company,  or  manning  a  station  on  a  ship. 

This  broadness  of  scope  is  beneficial  for  two  reasons.  First,  it  allows  for  a 
simpler  experiment.  A  more  detailed  military  scenario  might  present  a  convincing 
simulation  of  a  particular  task,  but  it  would  also  be  more  difficult  to  standardize  the  trials. 
This  is  particularly  important  for  drawing  statistical  inferences  from  the  results  of  the 
experiment. 
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The  second  benefit  of  using  a  broader  scope  is  that  the  results  are  easy  to 
generalize.  A  study  that  focused  on  the  communications  environment  of  a  single 
community  might  produce  results,  which  seemed  more  relevant  to  one  group,  but  it 
would  also  run  the  risk  of  appearing  inapplicable  to  others. 

Using  a  laboratory  and  generic  scenarios  provides  analytical  benefits,  but  also 
creates  significant  limitations.  Foremost  is  the  hypothetical  effect  that  the  lack  of  context 
could  have  on  performance.  Participants  might  respond  differently  when  placed  under 
the  demands  and  stresses  of  a  real  working  environment.  There  are  no  external  threats  in 
the  laboratory  setting  and  there  is  no  requirement  to  perform  a  vigilance  task,  such  as 
flying  or  driving. 

Another  limitation  of  this  research  is  that  it  does  not  explore  the  technical 
requirements  of  implementing  spatial  auditory  displays  in  a  military  environment.  This  is 
partially  a  function  of  conducting  research  in  a  laboratory  setting.  The  type  of  equipment 
used  for  this  research  might  work  in  some  environments,  like  shore  based 
communications,  but  clearly  would  not  work  in  others.  The  more  significant  issue, 
however,  is  the  need  to  limit  the  scope  of  this  research.  Similarly,  a  full  cost-benefit 
analysis  would  be  both  premature  and  outside  the  domain  of  the  research  objectives. 

Aside  from  the  setting,  other  limitations  exist.  From  the  technical  perspective, 
individualized  Head  Related  Transfer  Functions  (HRTFs)  were  not  used  in  this  research. 
Measuring  certain  outer  ear,  or  pinnae,  characteristics  and  using  them  as  parameters  in 
the  synthesis  of  spatial  audio  can  improve  the  ability  of  a  listener  to  localize  a  sound 
source. 

The  alternative  was  to  use  generalized  or  “generic”  HRTFs.  This  limitation  is 
not  significant  for  two  reasons.  First,  localization  accuracy  was  not  the  main  dependent 
variable  in  the  experiment.  The  ability  to  correctly  identify  the  position  of  a  source  could 
be  much  more  important  in  a  different  setting,  such  as  the  sonification  of  search  and 
detection  processes.  In  communications  however,  localization  is  only  important  to  the 
extent  that  it  improves  intelligibility.  Second,  the  cost  of  measuring  and  utilizing 
individual  HRTFs  in  a  field  setting  is  potentially  prohibitive.  One  difficulty  is  that  the 
measurement  process  would  need  to  be  conducted  for  all  personnel  that  intended  to  use  a 
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particular  application.  It  would  also  have  to  be  repeated  whenever  turnover  occurred. 
Additionally,  a  relatively  quiet  room  is  useful  for  measuring  HRTFs.  Noise  and  spaee 
limitations  are  obstaeles  that  would  exist  in  many  field  settings.  Finally,  a  proeess  would 
need  to  be  established  in  order  to  insure  that  the  correct  HRTFs  were  loaded  whenever  an 
applieation  was  used. 

If  a  performanee  inerease  exists  without  these  complieations,  it  is  important  to  use 
that  inerease  as  a  baseline  for  future  study.  Only  then  can  a  theoretical  improvement  be 
eompared  to  the  extra  eost  in  time,  money,  and  system  complexity. 


D.  ORGANIZATION 


The  thesis  is  organized  into  five  ehapters.  The  introductory  chapter  explains  the 
motivation  for  pursuing  this  topic  and  provides  a  very  general  baekground  on  the  use  of 
spatial  auditory  displays.  The  second  chapter  provides  foeus  for  the  researeh  question  in 
two  ways.  First,  it  presents  an  overview  of  the  principles  of  spatial  auditory  pereeption. 
Seeond,  it  summarizes  a  comprehensive  literature  review  by  describing  the  results  of 
several  experiments  that  have  dealt  with  either  responses  to  multiple  messages  or 
message  delivery  in  a  spatial  environment.  The  third  ehapter  deseribes  the  methodology 
and  analysis  of  a  pilot  study,  while  the  fourth  ehapter  uses  the  same  format  to  present 
results  from  a  larger  experiment.  Finally,  ehapter  five  contains  conclusions  and 
rec  ommendations . 
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II.  PROBLEM  FOCUS 


A,  SPATIAL  AUDITORY  ENVIRONMENTS 

1,  Basic  Elements  of  Auditory  Perception 

Sound  is  created  by  vibrations  from  a  souree  that  are  transmitted  as  a  pressure 
wave  with  alternating  peaks  and  valleys.  Theses  waves  ean  travel  through  a  variety  of 
media,  but  are  generally  deseribed  as  a  stimulus  transmitted  to  the  ear  through  the 
atmosphere.  (Sanders  and  McCormiek,  1993,  p.  161)  Simple  sounds  ean  be  represented 
as  a  sinusoidal  funetion  with  time  on  the  horizontal  axis  and  intensity  on  the  vertieal. 

The  two  primary  attributes  of  sound  are  intensity  and  frequeney.  Intensity 
eorresponds  to  the  amplitude  of  the  sine  wave.  The  distanee  from  the  horizontal  axis  to 
the  peak  of  a  wave  is  the  differenee  between  normal  air  pressure  and  the  maximum 
eondensation  eaused  by  the  sound  wave.  Intensity  is  normally  measured  in  deeibels, 
whieh  are  relative  units  to  some  referenee  level  on  a  logarithmic  scale  (Shilling  and 
Shinn-Cunningham,  2002,  p.  2.1.2). 

Frequency  (A,),  corresponds  to  the  wavelength,  or  distanee  between  adjaeent 
extrema,  of  the  sine  funetion.  Hertz  (hz),  or  cycles  per  seeond,  are  used  to  deseribe  the 
frequeney  of  a  sound.  Generally,  the  human  ear  ean  deteet  sounds  in  the  20-20,000  hz 
range,  but  there  is  signifieant  variation  in  sensitivity  to  individual  frequeneies.  It  is  also 
important  to  note  that  there  are  large  differenees  between  individuals  in  their  relative 
abilities  to  deteet  a  speeifie  frequeney  (Sanders  and  MeCormiek,  1993,  p.  161). 

The  meehanieal  and  eognitive  proeesses  of  human  hearing  are  eomplex.  The  full 
details  are  beyond  the  seope  of  this  researeh,  but  a  basie  overview  is  useful  for 
understanding  some  of  the  variables  that  affeet  spatial  hearing.  First  sound  is 
transformed  by  the  pinnae,  or  visible  portion  of  the  outer  ear.  More  speeifieally,  the  size 
and  shape  of  a  pinna  physieally  affeet  the  eolleetion  of  sound  energy.  This  stage  is  also 
influeneed  by  parts  of  the  body  that  are  elose  to  the  ears,  sueh  as  the  head  and  shoulders. 
Next,  aeoustieal  energy  is  eonveyed  through  the  meatus,  or  ear  eanal,  to  the  tympanie 
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membrane.  This  membrane,  also  ealled  the  eardrum,  works  in  eonjunction  with  three 
small  bones,  ealled  ossieles,  or  hammer-anvil-stirrup,  to  convert  acoustical  energy  to 
mechanical  energy.  This  energy  is  transferred  to  the  inner  ear,  or  cochlea,  via  the  oval 
window  and  continues  as  fluid  pressure.  This  pressure  causes  dependent  vibration 
patterns  of  the  basilar  membrane,  which  cause  numerous  fibers  protruding  from  auditory 
hair  cells  to  bend.  This  process  activates  electrical  action  potential  in  auditory  neurons 
and  combines  at  higher  levels  with  information  from  the  opposite  ear  to  produce  aural 
perception.  (Bergault,  2000,  p.  7) 

The  last  stage  in  this  account  is  clearly  crucial  to  the  way  in  which  humans  use 
auditory  stimuli.  Sounds  are  not  perceived  in  terms  of  waves  or  pressure  changes.  At  the 
cognitive  level,  frequency  and  intensity  are  perceived  as  loudness,  pitch  and  timbre.  For 
example,  listeners  are  generally  sensitive  to  intensity  on  a  logarithmic  scale.  As  a  result, 
the  repeated  doubling  of  a  sound's  intensity  level  is  normally  perceived  as  a  series  of 
volume  increases  that  are  equal  in  magnitude. 

Frequency  is  more  complex  because  the  general  example  of  the  sine  wave  only 
applies  to  pure  tones.  In  practice,  most  sounds  are  complex  combinations  of  frequencies. 
The  simplest  case,  called  harmonics  consists  of  a  pure  tone  at  a  particular  frequency  that 
is  combined  with  other  tones  whose  frequencies  are  multiples  of  each  other.  Even 
harmonics  are  relatively  uncommon  among  complex  sounds.  Some  aperiodic  sounds  do 
not  have  a  discernible  pitch  and  are  characterized  as  noise.  The  pitch  of  other  complex 
sounds  usually  depends  on  the  average  period  of  the  cyclical  variations  of  the  stimulus. 
(Shilling  and  Shinn-Cunningham,  2002,  p.  3.4) 

Timbre  is  even  more  difficult  to  define.  It  includes  the  qualities  of  sounds  that 
allow  a  listener  to  distinguish  between  two  sounds  of  the  same  pitch  and  loudness.  This 
also  raises  the  issue  that  perceptual  attributes  of  sound,  such  as  loudness  and  pitch,  are 
not  exact  correlates  of  frequency  and  intensity.  Interactions  exist  in  both  cases. 
Perceived  loudness,  for  instance,  is  not  a  simple  function  of  intensity  because  there  are 
instances  where  frequency  has  a  significant  effect.  Similarly,  intensity  can  affect 
perceptions  of  pitch.  This  is  particularly  true  with  complex  sounds. 
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Another  form  of  interaction  involves  the  presence  of  multiple  sound  sources  in  the 
same  environment.  In  this  case,  one  sound  can  have  a  masking  effect  on  another  sound. 
Masking  is  normally  defined  as  a  change  in  the  minimum  intensity  that  is  needed  to  make 
a  sound  detectable.  The  change  in  this  threshold  can  be  measured  and  attributed  to  a 
masking  effect.  The  extent  of  this  phenomenon  depends  on  frequency  and  intensity.  In 
general,  low  intensity  masking  (20  to  40  dB)  is  constrained  to  a  narrow  band  of 
frequencies  around  those  of  the  masking  sound,  while  higher  intensities  widen  the  range 
of  frequencies  that  are  affected.  (Sanders  and  McCormick,  1993,  p.l68) 

Speech  communications,  the  focus  of  this  study,  provide  a  practical  example  for 
the  masking  concept.  Since  most  speech  information  is  conveyed  by  sounds  that  are 
between  200  and  5000  Hz,  it  is  particularly  important  to  reduce  or  eliminate  the  intensity 
of  noise  in  this  range.  Otherwise,  word  intelligibility  and  message  comprehension  can  be 
compromised.  Obviously,  the  presence  of  multiple  speech  sounds  increases  the  chance  of 
overlapping  frequency  ranges.  This  is  one  of  the  reasons  why  spatial  separation  can  play 
a  vital  role  in  auditory  perception.  It  cannot  eliminate  the  detrimental  effects  of  masking 
or  conflicting  message  content,  but  it  can  potentially  moderate  them. 

2.  Spatial  Hearing 

Localizing  sound  in  space  is  a  perceptual  process  that  occurs  when  the  stimulus 
arriving  in  one  ear  is  compared  to  that  of  the  opposite  ear.  The  two  principal  cues  in 
spatial  auditory  perception  are  interaural  time  differences  (ITD)  and  interaural  intensity 
differences  (IID). 

ITDs  are  the  primary  spatial  cue  for  sounds  with  lower  frequencies.  For  sounds 
under  1.5  kHz,  the  half  period  of  a  sound  wave  is  normally  larger  than  the  size  of  the 
head,  so  the  brain  can  accurately  detect  the  phase  of  these  waves  and  the  ITD  cue  can 
function.  If  the  intensity  of  a  sound  wave  varies,  then  the  amplitude  modulation  creates 
an  envelope  at  a  frequency  much  lower  than  the  carrier  frequency.  Under  these 
conditions,  the  ITD  can  continue  to  operate  at  higher  frequencies.  (Bergault,  2000,  p.33) 
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At  higher  frequencies,  particularly  above  2  kHz,  sound  waves  are  generally 
smaller  than  the  head.  The  resultant  signal  diffraction,  or  head  shadowing,  causes  an 
intensity  difference  between  the  ear  that  is  closer  to  the  sound  source  and  the  one  that  is 
on  the  opposite  side  of  the  head  (IID).  For  sounds  that  are  closer  than  one  meter,  extra 
large  IID  cues  can  occur  from  the  relative  differences  in  the  distance  of  a  source  between 
one  ear  and  the  other.  These  cues  are  important,  even  for  low  frequency  sounds.  In 
addition,  a  torso  shadowing  effect  can  cause  an  IID  for  nearby  objects  that  increases  the 
accuracy  of  elevation  localization.  (Shilling  and  Shinn-Cunningham,  2002,  p.  3.6.1) 

The  combination  of  IID  and  ITD  cues  provide  accurate  localization  effects  in  a 
variety  of  circumstances,  but  the  resolution  of  this  auditory  process  is  not  as  consistent  as 
comparable  visual  processes.  First,  there  are  multiple  source  locations  that  produce  the 
same  ITD  and  IID  cues.  At  a  distance  of  more  than  a  meter  from  the  head,  these  points 
form  a  cone  of  confusion  where  the  location  of  a  sound  can  appear  ambiguous.  Inside  of 
one  meter,  there  are  corresponding  tori  of  confusion  centered  on  the  interaural  axis  that 
also  prevent  the  determination  of  a  sound  source's  location.  (Shilling  and  Shinn- 
Cunningham,  2002,  p.  3.6.1)  Second,  midrange  frequencies  between  1500  and  3000  Hz 
can  be  difficult  to  localize  because  they  do  not  produce  an  adequate  difference  in  phase 
or  intensity.  This  creates  a  front-back  confusion,  which  makes  it  easy  for  a  listener  to 
reverse  the  direction  a  sound  is  coming  from. 

There  are  several  other  factors  that  effect  localization.  Head  movement,  for 
instance,  is  the  primary  means  of  resolving  front-back  confusion.  Consider  a  polar 
coordinate  system  where  the  zero  degree  mark  is  located  directly  to  the  right  of  a  listener. 
A  stationary  sound  source  at  thirty  degrees  could  be  mistaken  for  a  sound  located  at  150 
degrees.  Turning  the  head  back  and  forth  can  resolve  this  uncertainty.  If  the  sound 
becomes  increasingly  centered  as  the  head  moves  to  the  right,  then  it  confirms  that  the 
sound  is  to  the  right  and  forward.  In  more  precise  terms,  the  centering  effect  is  a 
decrease  in  the  interaural  differences.  If,  on  the  other  hand,  the  differences  increased  as 
the  head  moved  to  the  right,  then  the  sound  would  have  to  be  to  the  left  and  rear 
(Bergault,  2000,  p.  39). 
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Finally,  the  role  of  higher-level  cognitive  processes  cannot  be  ignored.  Past 
experience  and  reasoning  often  override  judgments  that  would  be  formed  solely  from 
physical  stimuli.  In  particular,  expectation  can  often  dictate  both  visual  and  auditory 
spatial  perception.  Durand  Bergault  provides  the  account  of  a  famous  3-D  sound  system 
demonstration  in  which  the  listener  heard  the  sound  of  scissors  cutting  hair  near  the  ear. 
The  sensation  seemed  so  real  that  some  listeners  reached  for  their  heads  to  make  sure  that 
there  were  no  scissors.  Similarly,  the  sounds  of  a  cigarette  being  lit  and  a  person  drinking 
a  glass  of  water  produced  a  strong  sense  of  sounds  originating  from  an  area  in  front  of  the 
mouth.  As  Dr.  Bergault  pointed  out,  these  are  very  difficult  perceptions  to  produce  with 
interaural  cues  because  of  the  potential  for  reversals  in  this  area.  The  sound  system 
designer  argued  that  this  was  proof  of  the  quality  of  their  system,  but  Dr.  Bergault 
maintained  that  our  knowledge  of  similar  circumstances  shows  that  a  listener's 
experiences  with  these  activities  would  not  have  allowed  them  to  hear  the  sound  from 
anywhere  else.  He  went  further  to  contend  that  an  un-localized  monaural  display,  played 
into  both  ears  at  the  same  decibel  level  would  likely  cause  an  identical  spatial  perception. 
(Bergault,  2000,  p.  29) 


3.  Spatial  Auditory  Displays 

There  are  two  main  methods  of  re-creating  three-dimensional  auditory 

environments,  loudspeakers  and  headphones.  A  distinction  should  be  made  between  3-D 

and  surround  sound,  particularly  in  situations  where  speaker  configurations  are  used.  The 

primary  purpose  of  stereo  surround  sound  is  to  enhance  music  by  making  it  sound  more 

spacious.  This  effect  can  be  accomplished  by  adding  a  single  speaker  that  is  out  of  phase 

with  the  normal  left  and  right  stereo  speakers.  Theater  surround  sound  systems  are 

slightly  more  complex  because  they  utilize  up  to  four  separate  channels  for  sounds.  Most 

soundtracks  utilize  a  center  channel  for  dialogue,  regardless  of  where  the  speaker  is 

located  in  relation  to  the  audience.  Music  and  Foley  effects,  like  footsteps,  are  usually 

played  on  the  left  and  right  side  channels.  The  last  channel  connects  to  multiple  rear 

speakers  and  is  reserved  for  background  environmental  sounds  that  are  meant  to  be 

diffused  and  envelop  and  audience.  (Bergault,  2000,  pp.  16-17) 
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3-D  sound  environments  are  more  eomplex  beeause  sounds  are  represented  as 
emanating  from  precise  points  in  space.  The  limitations  of  loudspeakers  should  be 
obvious.  Each  position  in  a  360-degree  sphere  around  a  listener  potentially  requires  a 
separate  speaker  to  act  as  the  sound  source.  Room  characteristics,  like  reverberation,  also 
become  an  issue.  While  some  reverberation  can  add  a  sense  of  realism,  it  can  also 
confuse  localization.  Special  rooms,  called  anechoic  chambers,  eliminate  this  problem, 
but  they  are  expensive  and  unrealistic  for  most  practical  applications. 

More  often  than  not,  headphone  systems  present  a  cheaper  and  more  effective 
method  for  creating  three-dimensional  sound  environments.  Intensity  and  timing 
differences  between  the  left  and  right  ear  can  be  used  to  synthesize  the  perception  of  a 
sound  source  located  in  a  specific  position.  Of  course,  the  same  problems  that  cause 
reversals  and  confusion  in  real  listening  environments  also  apply  to  artificial  ones.  In 
addition,  there  are  new  problems  that  need  to  be  taken  into  account. 

The  major  disadvantage  of  traditional  headphone  techniques  is  that  sounds  can 
appear  to  come  from  inside  the  head,  even  when  interaural  difference  cues  are  utilized. 
Some  argue  that  this  is  a  natural  consequence  of  bone  conduction  or  pressure  on  the  head, 
but  there  are  several  factors  that  have  been  found  to  improve  this  condition.  The  addition 
of  head  tracking  devices  can  be  used  to  mimic  the  change  in  interaural  differences  that 
occur  when  the  head  moves  in  relation  to  a  stationary  sound  source.  This  technique 
carries  two  advantages.  First,  it  can  help  increase  the  perception  of  externalization,  a 
sense  that  the  sound  is  originating  from  outside  the  head.  Second,  it  can  improve 
localization  accuracy,  particularly  with  the  previously  mentioned  ability  to  resolve  front- 
back  ambiguity. 

A  second  technique  that  can  increase  externalization  and  improve  localization 
accuracy  is  the  use  of  head  related  transfer  functions  (HRTFs).  HRTFs  are  obtained  by 
measuring  the  pressure  put  on  the  eardrum  by  sound  pressure  originating  from  a  fixed 
point  in  space.  This  measurement,  also  known  as  a  Head  Related  Impulse  Response 
(HRIR),  is  repeated  by  moving  the  source  to  different  points  around  the  listener.  The 
final  product  of  this  mapping,  the  HRTF,  is  the  result  of  a  Fourier  transform  of  the  HRIR 
data.  HRTFs  account  for  individual  characteristics  that  can  influence  interaural 
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differences  through  signal  disruption.  These  can  include  the  size  and  shape  of  the  pinnae, 
distance  between  the  ears,  aspects  of  the  neck  and  shoulders,  and  even  facial 
characteristics.  Theoretically  the  use  of  HRTFs  allows  a  listener  to  hear  sounds  more 
naturally.  The  alternative  is  to  use  measurements  from  a  good  localizer  or  to  form  some 
type  of  average  HRTF. 


B,  PRIOR  COMMUNICATIONS  EXPERIMENTS 

1.  The  Cocktail  Party  Problem 

There  is  an  immense  amount  of  research  literature  associated  with  the  general 
topic  of  spatial  auditory  perception.  Rayleigh's  On  our  perception  of  sound  direction 
(1907)  was  published  in  Philosophica  magazine  nearly  a  century  ago.  Subsequent 
experimentation  covered  a  wide  variety  of  sub-topics,  including  the  effect  of  spatial 
separation  (binaural  versus  monaural  hearing)  on  masking  and  detection  thresholds. 

The  ability  of  a  listener  to  hear  one  sound  in  the  presence  of  a  competing  signal  is 
marginally  relevant  to  the  topic  of  multiple  message  environments,  but  it  is  important  to 
note  that  many  of  these  experiments  used  simplified  versions  of  real  perceptual  tasks.  For 
example,  research  conducted  by  Ira  Hirsh  at  Harvard  University^  in  1948  studied  the 
effect  of  interaural  phase  on  summation  and  inhibition.  He  referred  to  earlier  research, 
which  showed  the  advantageous  threshold  decrease  associated  with  binaural  displays. 
The  problem  with  this  group  of  studies  from  the  1930s  and  40s  is  that  they  concentrated 
on  target  sounds  that  consisted  of  pure  tones  and  masking  sounds  that  were  composed  of 
noise  (Hirsh,  1948,  p.l).  The  relevance  of  this  research  is  that  it  illustrates  that  there  are 
issues  associated  with  the  perception  of  complex  sounds,  like  speech,  that  can  be  ignored 
with  a  simplified  experiment.  The  problem,  of  course,  is  that  the  results  of  such 
experiments  are  less  significant  if  a  researcher  is  primarily  concerned  with  verbal 
communications. 


2  Dr.  Hirsh's  research  was  performed  under  contract  between  Harvard  University  and  the  Office  of 
Naval  Research. 
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In  1953,  E.  Colin  Cherry,  a  researcher  from  the  Imperial  College  of  the  University 
of  London,  published  an  article  entitled  Some  Experiments  on  the  Recognition  of  Speech, 
with  One  and  Two  Ears.  His  work  was  conducted  at  MIT  under  a  Fulbright  grant  and 
was  partially  funded  by  the  Army  Signal  Corps,  the  Air  Materiel  Command,  and  Office 
of  Naval  Research.  He  coined  the  phrase  "Cocktail  Party  Problem"  to  describe  a  situation 
in  which  a  listener  attempts  to  follow  one  conversation  in  a  room  full  of  people  who  are 
talking  in  small  groups. 

Cherry  listed  five  factors  that  he  felt  allowed  a  listener  to  discriminate  between 
conflicting  spoken  messages.  These  included  visual  cues  such  as  lip  reading;  differences 
in  voice  pitch,  timbre,  and  speed;  differences  in  accents;  transition  probabilities,  which  he 
used  to  describe  differences  in  subject  matter,  voice  dynamics  and  syntax;  and  lastly,  the 
fact  that  voices  come  from  different  directions.  (Cherry,  1953,  p.  976)  He  controlled  all 
variables  except  for  sound  direction  and  message  content  in  order  to  test  his  theory  that 
the  location  of  sound  played  a  major  role  in  the  filtering  of  multiple  messages.  He 
accomplished  this  by  recording  two  messages,  read  by  the  same  speaker,  onto  a  single 
tape.  The  result,  predictably,  was  nearly  incoherent  babble.  He  compared  the  ability  of 
participants  to  comprehend  message  details  from  these  un-separated  messages  to  a 
different  setup  in  which  one  message  was  played  into  each  ear  through  headphones. 

The  results  of  this  comparison  showed  a  dramatic  increase  in  performance  with 
separated  messages.  Message  comprehension  and  recall  noticeably  improved  for  the 
attended  message.  The  results  regarding  the  rejected  message  were  equally  interesting. 
Participants  could  recall  no  significant  details  of  the  message  that  they  ignored.  In  fact,  a 
subsequent  test  showed  that  a  participant  did  not  even  recognize  the  fact  that  the  rejected 
message  was  changed  to  German,  albeit  spoken  by  the  same  Englishman  who  read  the 
target  message.  (Cherry,  1953,  p.  978) 

Subsequent  experiments  on  the  effect  of  spatial  separation  on  multiple  message 
intelligibility  can  be  divided  into  two  categories.  The  first  category  used  two  or  more 
loudspeakers  to  create  localized  sound  sources.  The  second  group  used  headphones. 
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2.  Multiple  Message  Experiments  with  Loudpseakers 


In  1953  and  1954  a  pair  of  experiments  was  condueted  at  the  Human  Factors 
Division  of  the  U.S.  Navy  Electronics  Laboratory  in  San  Diego,  California.  J.C.  Webster 
and  P.O.  Thompson  sought  to  follow  up  Cherry's  work  with  a  study  that  required 
listeners  to  attend  to  both  of  two  overlapping  messages.  They  used  air  traffic  control 
operators  as  participants  and  graded  their  verbal  responses  to  simulated  tower 
communications  that  utilized  flight  identification  numbers  in  short,  three  word  messages. 

Two  configurations  were  used  to  deliver  messages.  The  first  sent  messages  from 
one  of  six  speakers  to  a  single  loudspeaker.  Up  to  two  messages  could  be  displayed  at 
once,  with  various  degrees  of  overlap.  The  second  configuration  used  six  loudspeakers, 
one  for  each  potential  message  source. 

The  results  showed  significant  improvement  in  word  and  flight  number 
identifications  with  the  multiple  speaker  display.  Furthermore,  Webster  and  Thompson 
tested  a  message  pull-down  system  that  showed  additional  improvement  when  one  of  the 
messages  could  be  redirected  into  either  a  seventh  speaker  or  a  single  earphone 
(Thompson  and  Webster,  1953,  p.399).  One  interpretation  of  this  result  is  that  the  pull¬ 
down  increased  the  intensity  difference  and  spatial  separation  between  the  two  messages. 
The  idea  that  the  angle  of  separation  might  influence  performance  was  not  explicitly 
studied  in  this  experiment,  but  it  was  pursued  a  year  later  by  Webster  and  two  other 
colleagues  at  the  Navy  Electronics  Laboratory. 

Walter  Spieth,  James  Curtis,  and  John  Webster  published  Responding  to  One  of 
Two  Simultaneous  Messages  in  1954.  Their  experiment  had  three  treatments  for  spatial 
separation.  Each  was  meant  to  display  messages  from  sources  that  were  given  the  call 
signs  of  Able,  Baker,  and  Charlie.  The  first  treatment  was  a  singe  speaker  that  would 
play  overlapping  messages.  The  second  was  a  three-speaker  array  with  10-20  degrees  of 
separation  between  speakers  and  the  third  was  a  similar  array  with  90-180  degrees  of 
separation.  Like  the  earlier  work  of  Thompson  and  Webster,  Spieth  et.  al.  also  tested 
pull-down  methods. 
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Each  message  eontained  several  elements.  The  first  was  an  identification  of  the 
message  channel,  Able,  Baker,  or  Charlie.  The  second  element  was  the  intended 
recipient.  One  message  would  always  be  addressed  to  Oboe,  the  eall  sign  for  the 
partieipant.  Another  message  would  be  addressed  to  one  of  nine  one-syllable  eode 
names.  Each  message  would  also  identify  a  speaker,  separately  from  the  ehannel 
identifieation.  Einally,  eaeh  message  would  contain  a  question  about  a  visual  display  in 
front  of  the  listener. 

Partieipants  were  graded  on  the  accuraey  of  their  responses  to  the  visual  display 
questions.  A  variety  of  parameters  affeeted  accuracy,  including  the  use  of  pull-downs 
and  visual  filters.  Regardless,  all  eases  showed  a  large  improvement  in  accuracy  when 
spatial  separation  was  used  and  a  small  additional  increase  when  the  larger  angle  of 
separation  was  used.  (Speith  et.  ah,  1954,  pp.  391-393) 

The  benefits  of  spatial  separation  raised  a  question  of  whether  some  angles  were 
more  beneficial  than  others.  As  an  example,  Thompson  and  Webster  revisited  this  issue 
in  1963  and  1964  by  examining  the  effeet  of  talker  listener  angles  on  word  intelligibility. 
Their  first  study  was  inconclusive  (Thompson  and  Webster,  1963,  p.323),  but  they  found 
a  benefit  in  turning  a  listener  15  to  75  degrees  from  a  talker  in  their  second  experiment. 
The  magnitude  of  the  benefit  was  roughly  equivalent  to  a  ehange  in  distance  of  three  and 
a  half  meters,  but  they  were  less  comfortable  with  this  result  beeause  there  were 
discrepancies  among  researehers  who  were  studying  this  question  (Thompson  and 
Webster,  1964,  p.  44).  Ultimately,  the  issue  was  of  limited  importance  for  topics 
involving  electronic  communications  because  there  are  many  factors,  like  shadowing 
effects  from  bodies  that  are  not  a  concern  unless  the  talker  and  listener  are  in  the  same 
vicinity. 

More  recently,  a  series  of  experiments  was  eondueted  at  the  Wright-Patterson  Air 
Eorce  Base  in  the  Armstrong  Eaboratory's  Bioeommunications  facility.  Specifically,  a 
group  of  tests  performed  in  1994  by  Riehard  McKinley  and  Mark  Ericson  tested  the 
effeets  of  a  3-D  Auditory  display  in  both  a  flight  demonstration  and  in  the  Armstrong 
Eaboratory.  The  laboratory  portion  of  their  experiment  used  a  geodesic  sphere,  with  272 
matehed  loudspeakers,  which  was  placed  in  an  aneehoic  ehamber.  They  conducted 
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several  studies  including  measures  of  localization  performance  and  communication 
studies. 

The  communications  experiment  involved  the  transmission  of  one,  two,  and  four 
messages  against  a  background  of  pink  noise.  Messages  contained  a  call  sign,  a  color, 
and  a  number.  Intelligibility  was  evaluated  using  a  coordinate  response  measure  (CRM). 
The  results  indicated  an  increase  in  the  percent-correct  CRM  measure  when  spatial 
separation  was  used.  The  amount  of  the  improvement  varied,  but  the  average  was  25- 
28%  higher  than  the  diotic  presentation.  (McKinley  and  Ericson,  1995,  p.  695) 

McKinley  and  Ericson's  communication  experiment  is  significant  because  it 
provided  a  quantitative  measure  of  performance  in  a  spatial  auditory  environment  with  up 
to  four  competing  message  sources.  The  shortcoming  is  that  the  auditory  display  took 
place  in  an  impractical  setting.  Eirst,  anechoic  chambers  are  difficult  and  potentially 
expensive  to  construct.  Second,  while  the  geodesic  sphere  is  more  space  efficient  than 
the  24-speaker  array  that  had  been  used  previously,  its  performance  might  have  been 
dependent  on  the  room  conditions. 

Despite  the  importance  of  early  experiments  that  utilized  loudspeakers  to  create 
spatial  audio  displays,  there  are  limited  practical  applications  for  these  types  of 
configurations.  Headphone  systems,  on  the  other  hand,  have  the  potential  to  be  applied 
to  a  wide  variety  of  settings.  They  generally  require  less  space  and  they  limit  some  of  the 
external  concerns  that  have  driven  researchers  to  build  complex  acoustic  environments. 
The  space  consideration  by  itself  could  be  the  deciding  factor  in  many  military 
applications.  The  display  that  McKinley  and  Ericson  used  for  the  flight  demonstration 
portion  of  their  research  is  a  good  example  of  a  3-D  audio  display  that  was  integrated  into 
a  practical  field  application. 

3.  Multiple  Message  Experiments  with  Headphones 

The  flight  demonstrations  described  by  McKinley  and  Ericson  were  conducted  as 
a  joint  effort  by  the  Air  Eorce  and  Navy  with  T-1  AV-8B  Harrier  VTOE  aircraft. 
McDonnell  aircraft  integrated  Armstrong  Eaboratory's  3-D  audio  system  with  the  AV¬ 
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SB's  mission  computer.  A  modified  Centex  HGU-53/P  flight  helmet  ineluded  a  Bose 
PRU-57  headset  with  military  aetive  noise  reduction  (ANR)  capabilities.  The  headset 
system  also  included  a  head  tracker  that  had  been  implemented  for  a  previous  study. 

Four  Navy  and  Marine  Corps  pilots  participated  in  two  sets  of  tests.  The  first  set 
consisted  of  localization  tests  that  were  intended  to  measure  the  effeetiveness  of  a  3-D 
audio  cue  in  target  identifieation  and  diserimination  activities.  The  second  set  included 
the  use  of  a  3-D  audio  display  for  communications,  but  the  only  performance  measures 
reported  were  the  subjective  ratings  of  the  pilots. 

The  communications  tests  were  relevant  to  this  researeh  beeause  they  demonstrate 
the  ability  to  implement  3-D  audio  headphone  displays  in  a  real  military  environment. 
Unfortunately,  the  data  reported  in  this  experiment  was  limited  to  aneedotal  accounts 
provided  by  the  participants.  One  pilot  eommented  that  he  would  not  have  been  able  to 
copy  dual  message  traffie  without  the  display.  The  other  three  pilots  liked  the  system  but 
"did  not  consider  it  a  high  priority"  (McKinley  and  Erieson,  1995,  p.696). 

During  the  1980's,  researchers  at  the  NAS  A- Ames  Researeh  Center  were 
eoneerned  with  many  of  the  same  questions  as  their  Air  Foree  counterparts  at  the 
Armstrong  Laboratory.  Elizabeth  Wenzel  began  the  development  of  an  auditory 
localization  system,  eventually  dubbed  the  Convolvotron  that  was  similar  in  basic 
functionality  to  the  system  that  was  used  by  McKinley  and  Erieson.  Both  eenters  were 
largely  concerned  with  issues  sueh  as  localization  accuracy  and  modeling  HRTFs,  but 
there  was  also  a  peripheral  eoneem  with  communieations  applieations. 

In  1993,  Durand  Bergault,  a  colleague  of  Dr.  Wenzel's,  conducted  an  experiment 
that  measured  the  effect  of  a  spatial  auditory  display  on  message  intelligibility.  His 
intention  was  to  quantify  the  advantage  of  spatial  separation  in  terms  of  threshold 
changes.  In  some  ways,  this  concept  was  similar  to  experiments  that  had  been  performed 
in  the  1940s  with  simple  binaural  separation.  These  experiments  had  played  a  pure  tone 
in  one  ear  (0  degrees)  and  noise  in  the  other  (180  degrees).  The  results  had  shown  an 
advantageous  shift  in  the  detection  threshold  and  were  eited  by  Cherry  when  he  published 
his  findings  in  1953. 
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The  important  difference  between  research  done  in  the  1940s  and  the  studies 
conducted  fifty  years  later  is  that  the  more  recent  experiments  moved  beyond  measuring 
signal  detection  to  the  intelligibility  of  complex  sounds.  Dr.  Bergault  utilized  a 
vocabulary  of  130  call  signs  that  are  typically  used  in  NASA  communications  at  the 
Kennedy  Space  Center. 

During  the  experiment,  call  signs  were  played  in  one  location  while  speech 
babble  was  played  at  another.  Participants  were  prompted  to  type  in  the  call  signs  that 
they  heard.  Each  was  four  letters  in  length,  mostly  acronyms.  The  final  results  showed 
two  things.  First,  spatial  separation  offered  an  advantage  over  a  diotic  presentation. 
Second,  placing  sound  sources  at  60  and  90  degrees  appeared  to  offer  an  additional 
advantage  over  the  simple  binaural  case,  which  uses  0  and  180  degrees.  (Bergault,  1993, 
p.7) 

Dr.  Bergaulfs  conclusion  that  a  true  3-D  auditory  display  is  at  least  as  good  as  a 
binaural  display  is  significant.  It  has  been  obvious  for  some  time  that  there  is  an 
advantage  to  separating  sound  sources,  but  if  true  spatialization  does  not  offer  an 
additional  benefit,  then  there  is  no  reason  to  add  extra  complexity  to  an  auditory  display. 
There  is  another  important  aspect  to  this  question,  specifically,  whether  it  is  feasible  for  a 
listener  to  attend  to  more  than  two  messages  at  the  same  time?  If  it  is  possible,  then  the 
advantages  of  spatialization  could  be  measured  not  just  in  the  decibel  change  of  an 
intelligibility  threshold,  but  also  in  the  increased  ability  to  handle  multiple  channels  of 
communication. 
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III.  PILOT  STUDY 


A,  METHODOLOGY 

1,  Overview 

Over  the  last  seventy  years,  researehers  have  established  the  advantage  of  using 
spatial  separation  when  two  sound  sources  are  delivered  over  headphones.  More 
recently,  McKinley  and  Ericson  demonstrated  the  advantage  of  using  spatial  separation 
when  up  to  four  messages  are  delivered  by  an  array  of  speakers  in  an  anechoic  chamber. 
The  purpose  of  the  experimental  portion  of  this  research  was  to  determine  if  a  similar 
advantage  existed  for  up  to  four  messages  that  are  presented  through  headphones. 

The  working  hypothesis  for  this  experiment  was  that  participants  would 
accurately  respond  to  overlapping  messages  more  frequently  if  the  messages  were 
spatially  separated.  The  testing  of  this  hypothesis  required  preparation  in  the  form  of  a 
pilot  study.  This  initial  study  utilized  less  than  half  the  number  of  participants  of  the  final 
experiment  and  focused  on  graduate  students  who  had  specialized  in  Human  Factors 
research.  The  intention  was  to  collect  suggestions  from  participants  who  were  aware  of 
experimental  design  principles,  and  to  use  those  suggestions  to  improve  the  effectiveness 
of  the  protocol  for  the  final  study. 

2,  Messages 

Three-hundred-sixty  messages  were  scripted  using  the  same  basic  template. 
Similar  to  Webster  and  Thompson's  experiment  with  overlapping  messages,  each 
message  contained  the  call  sign  of  the  person  being  addressed  and  the  call  sign  of  the 
person  speaking.  Instead  of  a  reference  to  a  visual  display,  however,  the  message 
contained  a  short  sentence  that  ended  with  a  coordinate.  Each  coordinate  was  composed 
of  the  combination  of  an  alphabetical  and  a  numeric  component.  For  example,  a  speaker 
designated  as  "Yankee  Two"  might  say,  "Yankee  One,  this  is  "Yankee  Two".  Attacking 
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target  at  Echo  Six.  Over!"  The  call  signs  of  the  potential  message  sources  were 
established  as  "Control",  "Zulu  One",  "Yankee  Two",  and  "Yankee  Three".  "Yankee 
One"  was  set  aside  as  the  call  sign  for  the  participant,  so  any  messages  addressed  to  this 
call  sign  would  be  designated  as  target  messages.  Messages  addressed  to  one  of  the  other 
entities  were  referred  to  as  distracter  messages. 

"Control"  was  described  as  an  abstract  entity  that  was  superior  to  the  participant. 
"Zulu  One"  was  described  as  a  peer,  while  "Yankee  Two"  and  "Yankee  Three"  were 
referred  to  as  subordinates.  This  meant  that  "Control"  would  address  "Yankee  One"  or 
"Zulu  One".  "Zulu  One"  would  address  "Control"  or  "Yankee  One".  "Yankee  Two"  and 
Three  would  address  "Yankee  One"  or  each  other.  These  relationships  are  shown  in  the 
following  table. 


Call  Sign 

Addresses  Messages  to 

Control 

Yankee  One,  Zulu  One 

Zulu  One 

Yankee  One,  Control 

Yankee  Two 

Yankee  One,  Yankee  Three 

Yankee  Three 

Yankee  One,  Yankee  Two 

Table  1.  Call  Sign  Relationships 


Coordinates  were  arranged  with  the  numbers  one  through  eight  on  one  axis  and 
the  letters  A  (Alpha)  through  H  (Hotel)  on  the  other  axis.  The  portion  of  the  message 
before  the  coordinate  was  extraneous  material  that  was  intended  to  provide  a  generic 
military  context  for  the  experiment.  References  to  attacking,  moving,  detecting,  etc.  did 
not  require  any  response  or  acknowledgement  from  the  participant.  Additionally,  each 
speaker  used  only  two  phrases  before  giving  a  coordinate;  one  phrase  for  target  messages 
and  one  for  distracter  messages.  The  only  variation  between  messages  in  the  same 
category  was  in  the  coordinate. 

Two  sets  of  messages  were  recorded.  The  first  set  contained  60  messages  from 
"Control"  and  60  messages  from  "Zulu  One".  Target  and  Distracter  messages  were 
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evenly  divided,  so  eaeh  voiee  had  30  of  eaeh.  The  second  set  of  messages  utilized  all 
four  call  signs  ("Control",  "Zulu  One",  "Yankee  Two",  and  "Yankee  Three").  Each 
speaker  had  15  target  messages  and  45  distracter  messages.  Like  the  two-voice  set,  this 
allowed  for  60  combinations  of  messages. 

Messages  were  recorded  with  a  standard  PC  microphone  on  a  Dell  Dimension 
8100  using  a  SoundBlaster  Live  audio  card.  Sonic  Loundry's  Sound  Lorge  5.0  was  used 
to  record,  store,  and  edit  the  messages  in  Microsoft's  Wave  fde  (.wav)  audio  format. 
More  specifically,  messages  were  recorded  as  RILL  waves  (PCM),  at  a  44,100  Hz 
sampling  rate  in  16-bit  mono.  Peak  intensity  was  adjusted  for  each  message  to 
standardize  the  sound  level  between  competing  messages.  Messages  were  presented  over 
headphones  at  approximately  55-  60  dB  in  a  room  with  background  noise  at  45  dB. 

3.  Hardware 

Messages  were  presented  over  a  pair  of  hi-fidelity,  high  definition  Sennheiser  HD 
570  headphones.  Localization  was  performed  by  an  AuSim  GoldServe  Sound 
Localization  server.  This  system  was  capable  of  performing  real-time  localization  with 
multiple  sound  sources  by  synthesizing  cues  such  as  the  interaural  time  and  intensity 
differences.  It  used  both  C++  and  JAVA  application  programming  interfaces  (API)  and 
came  bundled  with  a  set  of  client-server  applications.  During  the  pilot  study,  all 
interfaces  were  run  on  a  Dell  Dimension  8100  client  computer  that  was  connected  to  the 
server  using  the  RS-232  communications  protocol. 

4.  Software 

The  primary  tool  used  for  message  playback  was  an  AuSim  client  application 
called  “Nordjorvik”.  This  program  allowed  the  user  to  define  coordinate  locations  for 
multiple  sound  sources  and  save  them  to  a  file.  When  the  file  was  loaded,  a  command 
was  sent  to  the  server  for  each  source  instructing  it  to  play  the  pre-defined  wave  file. 
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For  data  collection,  a  Microsoft  Access  database  was  used  to  collect  participant 
responses.  This  data  was  imported  into  Excel  where  responses  were  graded  with  a  series 
of  conditional,  or  if-then,  functions.  Some  rudimentary  analysis  was  also  done  in  Excel, 
though  the  majority  of  the  statistical  models  were  built  in  S-plus. 


5.  Participants 

Participants  included  three  women  and  eight  men.  All  were  either  active  duty 
military  or  veterans  and  had  at  least  a  bachelor's  degree.  Ten  of  the  eleven  participants 
were  graduate  students.  None  of  the  participants  reported  hearing  abnormalities. 

6.  Procedure 

Participants  were  asked  to  sit  at  the  client  computer,  read  a  set  of  experimental 
instructions,  and  sign  participant  consent  forms.  The  instructions  described  the  basic 
purpose  of  the  study,  listed  the  possible  call  signs,  and  illustrated  the  coordinate  system. 
Eurther  explanation  was  provided  by  the  experimenter  and  the  participant  was  asked  if 
they  had  any  additional  questions.  The  experimenter  then  demonstrated  the  use  of 
Nordjorvik  and  the  Access  form  that  was  used  to  collect  data.  Eor  each  trial,  the 
participant  was  expected  to  load  the  appropriate  file  and  listen  to  the  messages.  They 
were  then  asked  to  select  the  speaker  that  addressed  them  and  the  coordinate  from  the 
corresponding  message.  This  was  accomplished  with  the  use  of  drop  down  menus  that 
listed  all  of  the  possible  answers  for  each  category.  Einally,  the  participant  used  the 
<enter>  key  to  advance  to  the  next  record  and  the  new  record  number  was  used  as  an 
index  to  load  the  next  trial. 

Each  participant  listened  to  120  sets  of  messages.  Half  of  the  sets  used  two 
overlapping  messages,  while  the  other  half  used  four  overlapping  messages.  The  first  six 
participants  had  messages  presented  without  spatial  separation.  The  last  five  participants 
listened  to  messages  with  separation.  Two  voices  at  a  time  were  placed  at  45  degrees  and 
135  degrees.  Eour  voices  were  placed  at  45,  135,  225,  and  315  degrees. 
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Figure  1 .  Placement  of  sound  sources  with  two  and  four  speakers 

The  experimental  script  was  identical  for  each  of  the  participants.  Combinations 
of  messages  had  been  determined  randomly  using  a  program  written  in  the  JAVA 
language.  For  both  the  two  and  four  message  trials,  the  program  randomly  selected  an 
element  from  an  array  of  60  objects  without  replacement.  For  the  two-message  trials  this 
array  was  populated  with  30  ones  and  30  twos.  For  the  four-message  trials,  there  were  15 
ones,  15  twos,  15  threes,  and  15  fours.  This  insured  that  an  equal  number  of  target 
messages  would  be  delivered  by  each  voice. 

The  selected  element  from  these  groups  determined  which  voice  would  deliver 
the  target  message.  For  example,  in  the  two  voice  trials,  if  a  one  was  drawn,  then  the 
target  message  would  come  from  the  group  of  target  messages  spoken  by  Control  and  the 
distracter  would  come  from  the  group  of  distracter  messages  spoken  by  "Zulu  One".  If  a 
two  was  drawn,  the  target  message  would  come  from  the  group  of  target  messages 
spoken  by  "Zulu  One"  and  the  distracter  would  come  from  the  group  of  distracter 
messages  spoken  by  "Control". 

With  the  four  voice  trials,  there  were  four  cases  that  were  used  after  the  initial 
draw.  For  example,  if  a  three  were  initially  drawn,  then  the  program  would  select  a  target 
message  from  "Yankee  Two's"  list  of  target  messages.  Then  it  would  select  a  distracter 
message  from  the  distracter  lists  of  "Control",  "Zulu  One",  and  "Yankee  Three".  The  end 
result  was  that  each  voice  delivered  the  target  message  15  times  for  a  total  of  60  trials. 
By  extension,  every  voice  had  to  serve  as  a  distracter  in  the  remaining  45  trials. 
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This  process  was  repeated  until  a  script  was  generated  that  contained  120  trials, 
two  sets  of  60,  and  utilized  all  360  messages.  A  hand  eheek  was  performed  to  insure  that 
no  voice  was  selected  to  deliver  the  target  message  more  than  five  times  in  a  row.  The 
results  of  this  script  were  hard  coded  into  the  Nordjorvik  .TCD  fdes,  whieh  were  loaded 
sequentially  by  the  participant  during  the  experiment. 

Responses  to  each  trial  were  stored  in  a  database  table  that  had  one  column  for  the 
speaker  response,  one  for  the  alphabetieal  coordinate,  and  one  for  the  numerie  coordinate. 
Once  the  data  was  moved  to  Excel,  a  logical  test  was  used  to  compare  the  participant’s 
response  to  the  correet  answer.  The  eomparison  reduced  the  responses  to  binary 
variables. 

B,  ANALYSIS 

1.  Qualitative  Observations 

There  were  a  number  of  observations  made  by  the  experimenter  and  participants 
that  influenced  the  analysis  of  the  pilot  data.  Certain  areas  of  eoneern  also  affeeted  the 
design  of  the  final  experiment.  Comments  were  generally  divided  into  two  categories. 
The  first  eategory  consisted  of  broad  procedural  issues,  including  the  data  colleetion 
interface.  The  second  category  foeused  on  issues  with  the  message  files  and  the  proeess 
of  listening  to  the  individual  trials. 

The  main  proeedural  issues  were  related  to  the  meehanisms  for  colleeting  data 
and  loading  trials.  Requiring  participants  to  load  their  own  trials  was  considered  both 
tedious  and  a  potential  source  of  errors.  The  method  of  advaneing  to  the  next  record  was 
also  confusing  for  many  users.  If  they  filled  in  the  response  fields  out  of  order,  then  they 
would  have  to  hit  <enter>  more  than  once  to  enter  data  for  that  trial.  There  was  also  a 
button  at  the  bottom  of  the  form  that  advanced  the  record,  but  it  was  small  and  difficult  to 
distinguish  from  nearby  buttons.  Two  users  speeifieally  mentioned  that  the  use  of  two 
input  modalities  increased  the  mental  effort  and  decreased  the  speed  of  data  collection. 
Response  time  was  not  measured  or  analyzed,  but  the  number  of  trials  was  large  enough 
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that  participants  were  motivated  to  move  along  at  a  steady  pace.  As  a  result,  they  tended 
to  express  frustration  with  aspects  of  the  interfaee  that  slowed  them  down. 

The  length  of  the  experiment  was  also  mentioned  as  a  possible  influence  on  trial 
to  trial  differenees  in  aeouraey.  Specifieally,  there  was  a  concern  that  fatigue  or 
momentary  lapses  in  coneentration  would  cause  errors  that  were  unrelated  to  the 
treatment  conditions.  However,  it  must  also  be  remembered  that  sustained  vigilanee  is  a 
major  part  of  task  performance  in  the  real  world.  Similarly,  the  large  number  of  trials 
also  introdueed  the  possibility  that  a  participant  would  be  more  aecurate  as  they 
progressed  through  the  trials.  This  potential  for  a  learning  or  fatigue  effect  could  unduly 
affect  trial-to -trial  probabilities  of  success. 

2,  Cochran’s  Test  for  Related  Observations 

An  experimental  design  technique,  called  "bloeking",  can  be  used  to  examine  the 
effectiveness  of  a  group  of  treatments.  In  order  to  address  the  question  of  trial-to-trial 
probabilities  of  success,  it  is  possible  to  look  at  the  trial  number  as  the  treatment  and 
determine  whether  all  treatments  are  equally  effeetive. 

For  eaeh  measure  of  accuracy,  a  matrix  of  ones  and  zeros  was  constructed.  The 
rows  of  the  matrix,  also  known  as  the  bloeks,  corresponded  to  individual  participants. 
The  treatments,  which  were  the  trial  numbers  in  this  case,  formed  the  columns.  Cj  is  the 
total  for  eolumn  j,  Ri  is  the  total  for  row  i,  c  is  the  number  of  columns,  and  N  is  the  total 
number  of  observations.  The  following  formula  can  be  used  to  test  the  null  hypothesis 
that  all  treatments  are  equally  effeetive  (Conover,  1999,  251): 


T  =  c{c-\) 


Zk.-f) 


(3.2) 
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The  statistic  for  this  test  is  difficult  to  calculate  by  hand  because  the  matrices  for 
the  pilot  data  are  either  6  x  60  or  5  x  60.  Although  this  test  is  not  available  in  S-Plus, 
SPSS,  or  Minitab,  it  can  be  executed  in  S-plus  with  a  series  of  command  line  instructions 
provided  by  Professor  Robert  Read  of  the  Naval  Postgraduate  School.  The  example  in 
figure  2  shows  how  T  was  calculated  using  speaker  identification  as  the  measure  of 
accuracy  and  response  data  from  the  participants  who  received  spatialization  as  the 
blocks.  This  particular  set  of  data  only  applies  to  the  two  voice  trials. 

>  start . treat_c ( 120* 6 : 10 ) 

>  start. treat 

[1]  720  840  960  1080  1200 

>  ind . 2vtreat_NULL 

>  for  (j  in  1:5)  ind. 2vtreat_c (ind. 2vtreat,  start . treat [ j ] +1 : 60 ) 

>  speak . 2vtreat_matrix (Pilot .Data [ ind . 2vtreat , " Speaker" ] , 60,5) 

>  speak . 2vtreat_matrix (as . numeric ( speak . 2vtreat ) , 60 , 5 ) 

>  speak . mat_t ( speak . mat ) 

>  speak . 2vuntreat_t ( speak . 2vuntreat ) 

>  RR_apply ( speak . 2vuntreat , 1 , sum) 

>  CC_apply ( speak . 2vuntreat , 2 , sum) 

>  N_sum(RR) 

>  TT_60* (59) *sum ( (CC-N/60) "2) / (sum (RR* (60-RR) ) ) 

>  TT 

[1]  68.0438 

>  1-pchisq (TT, 59) 

[1]  0.1965179 


Figure  2.  Sample  S-plus  code  for  Cochran's  Test 

The  last  line  of  this  code  provides  the  p-value  for  a  test  conducted  with  the  chi-squared 
distribution  and  c-1  degrees  of  freedom.  At  a  significance  level  of  .05,  the  null 
hypothesis  was  not  rejected,  which  means  that  the  treatments  were  equally  effective.  In 
this  case,  it  indicates  that  the  individual  trials  were  equally  likely  to  produce  a  correct 
response. 

This  test  was  conducted  on  the  speaker,  alphabetical  coordinate,  and  numerical 
coordinate  measures  of  accuracy.  Each  of  these  groups  was  further  subdivided  by 
number  of  voices  and  categorized  by  spatialization.  Initially,  the  set  using  two  voice 
trials  with  the  speaker  identification  was  one  of  only  two  groups  of  data  that  did  not  lead 
to  the  rejection  of  the  null  hypothesis.  This  changed,  however,  when  the  first  five  trials 
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were  excluded  from  the  analysis.  Unfortunately,  the  change  was  only  observable  with 
the  two  voice  data.  The  following  table  summarizes  the  results  of  these  tests. 


Number  of 
Voices 

Spatialization 

Accuracy 

Measure 

p-value 

Conclusion 

a=  .05 

Two 

No 

Speaker 

.197 

Equally 

Effective 

Two 

Yes 

Speaker 

.822 

Equally 

Effective 

Two 

No 

Alpha 

.158 

Equally 

Effective 

Two 

Yes 

Alpha 

.296 

Equally 

Effective 

Two 

No 

Numeric 

.778 

Equally 

Effective 

Two 

Yes 

Numeric 

.379 

Equally 

Effective 

Four 

No 

Speaker 

.042 

Not  Equally 
Effective 

Four 

Yes 

Speaker 

.024 

Not  Equally 
Effective 

Four 

No 

Alpha 

.000 

Not  Equally 
Effective 

Four 

Yes 

Alpha 

.005 

Not  Equally 
Effective 

Four 

No 

Numeric 

.000 

Not  Equally 
Effective 

Four 

Yes 

Numeric 

.093 

Equally 

Effective 

Table  2.  Results  of  Cochran's  Test 
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These  results  show  that  the  small  learning  effeet  that  may  have  been  present  in  the 
two  voiee  trials  could  have  been  eliminated  with  a  short  practice  session.  They  also  show 
that  there  were  one  or  more  factors  that  caused  the  probability  of  success  for  the  four 
voice  trials  to  be  inconsistent.  The  problem,  however,  is  that  there  is  no  way  to  tell  how 
much  of  the  effect  was  due  to  learning,  how  much  was  due  to  fatigue,  and  how  much  was 
due  to  other  causes  There  is  also  no  way  to  tell  from  this  test  whether  the  magnitude  of 
the  effect  is  a  cause  for  concern. 

3.  Graphical  Examination  of  the  Learning  Effect 

Time  series  plots  were  used  to  examine  cumulative  accurate  responses  over  the 
course  of  sixty  trials.  The  total  number  of  correct  responses  for  each  participant  was 
normalized  to  one,  so  that  multiple  participants  could  be  compared  on  a  single  plot. 
Without  a  learning  effect,  each  line  should  rise  relatively  evenly  from  zero  to  one.  Runs 
of  multiple  trials  without  a  new  success  result  in  plateaus  that  can  give  the  line  a  step¬ 
wise  appearance. 

Figure  3  shows  a  plot  for  the  six  participants  who  listened  to  overlapping 
messages  without  spatialization.  Additionally,  the  plot  is  based  on  the  speaker 
identification  variable  during  the  two  voice  trials.  Each  line  represents  the  progress  of  an 
individual  participant.  Notice  that  even  though  most  of  the  lines  are  relatively  straight, 
one  of  the  lines  dips  significantly  during  the  first  fifteen  trials.  This  dip  is  caused  by 
several  long  periods  at  the  beginning  of  the  sequence  in  which  this  participant  had  no 
successes.  This  type  of  trend  suggests  a  learning  effect  for  that  participant. 

According  to  Cochran's  Tests,  there  should  not  be  major  trial-to-trial  effects  in 
this  particular  subset  of  the  data.  The  problem  is  that  this  test  looked  at  the  participants 
as  a  whole.  Data  was  blocked  by  participant,  but  the  test  still  had  to  produce  a  single 
statistic  for  the  entire  group,  which  means  that  the  differences  between  individuals  could 
be  masked  by  this  aggregation. 
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Figure  3.  Time  Series  Plot.  Two  voices,  Untreated,  Speaker  Identification 

In  general,  these  plots  confirmed  the  results  of  Cochran's  test.  Learning  effects 
were  not  as  noticeable  in  the  two  voice  trials  as  would  have  been  expected.  Additionally 
they  were  normally  confined  to  one  or  two  participants.  In  the  four  voice  trials,  there 
were  frequently  longer  plateaus,  but  this  appears  to  have  been  a  function  of  the  task 
difficulty  and  not  indicative  of  a  particular  trend.  An  example  of  this  is  shown  in  Figure 
4. 

The  reason  the  four  voice  lines  look  more  like  stepwise  functions  is  that 
participants  tended  to  accumulate  far  fewer  successes  than  they  did  in  the  two  voice 
trials.  As  a  result,  a  single  new  success  would  cause  a  larger  jump  in  the  proportion  of 
total  successes.  For  example,  in  the  two  voice  trials  it  was  not  uncommon  for  a 
participant  to  give  more  than  fifty  accurate  responses  for  many  of  the  measures  of 
accuracy.  This  meant  that  each  success  in  the  time  series  plot  would  result  in  an  increase 
of  two  percent  or  less.  In  contrast,  a  single  success  with  the  four  voice  trials  could  result 
in  an  increase  of  an  increase  of  more  than  five  percent. 
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Figure  4.  Time  Series  Plot.  Four  voices,  Treated,  Speaker  Identification 

For  the  most  part,  the  plateaus  for  the  four  voice  time  series  plots  did  not  exhibit  a 
noticeable  trend.  One  exception  to  this  rule  was  the  plot  for  the  participants  who 
received  no  spatialization,  and  who  attempted  to  identify  the  alphabetical  portion  of  the 
coordinate  with  four  overlapping  messages.  This  plot  is  shown  below  as  Figure  5  and 
appears  to  demonstrate  a  decrease  in  accuracy  at  the  end  of  the  sequence. 

An  explanation  of  this  and  similar  effects  could  serve  as  a  research  topic  on  its 
own.  For  example,  it  is  possible  that  users  became  fatigued  more  easily  when 
spatialization  was  not  used.  For  the  purposes  of  this  analysis,  however,  it  is  sufficient  to 
confirm  the  results  of  Cochran's  test,  which  showed  that  there  are  frequently  variations  in 
accuracy  that  are  attributable  not  just  to  spatialization,  but  also  to  the  progression  in  the 
trial  sequence.  Furthermore,  it  is  important  to  emphasize  that  these  trends  did  not  affect 
all  participants  equally. 
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Figure  5.  Time  Series  Plot,  Four  voiees,  Untreated,  Alphabetical  Coordinate 


2,  Chi-squared  Tests  for  Independence 


A  chi-squared  test  for  independence  was  the  first  quantitative  method  used  to 
analyze  the  results  of  the  pilot  study.  The  number  of  responses  to  each  measure  of 
accuracy  were  divided  into  four  cells.  The  columns  of  a  2x2  matrix  were  used  to  separate 
responses  from  spatialized  (treated)  and  non-spatialized  (untreated)  trials.  The  rows  were 
used  to  sort  correct  responses  from  incorrect  responses.  Figure  6  shows  the  form  of  the 
resulting  contingency  table. 


Correct 

Incorrect 


Treated  Untreated 


011 

012 

021 

022 

Ci  C2 


Ri 

R2 

N 


Figure  6.  2x2  contingency  table 
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In  this  case  the  column  totals  are  fixed  beeause  the  number  of  treated  and 
untreated  trials  were  known  before  hand.  The  row  totals,  however,  are  random  beeause 
the  number  of  eorreet  responses  was  not  known  until  the  experiment  was  eondueted. 

The  null  hypothesis  for  this  test  states  that  the  rows  and  columns  are  independent. 
This  can  be  expressed  more  formally  as  P(row  i,  column])  =  P(row  i)  *  P(column  j).  In 
this  case,  the  null  hypothesis  is  that  the  probability  of  a  eorreet  response  is  independent  of 
spatialization.  A  test  statistic  can  be  constructed  by  eomparing  the  observed  values  of  the 
eells  to  the  values  that  would  be  expected  under  the  assumption  of  independenee.  The 
expected  value  for  a  cell  is  found  by  dividing  the  produet  of  the  eell's  row  (Ri)  and 
column  (Ci)  totals  by  the  total  number  of  observations  (N).  The  following  formula  is 
then  used  to  derive  the  test  statistie: 


I  j 


Eij 


(3.1) 


The  null  distribution  of  this  statistie  is  given  approximately  by  the  ehi-squared 
distribution  with  (r-l)(c-l)  degrees  of  freedom.  Aecording  to  W.J.  Conover,  the  exact 
distribution  is  very  diffieult  to  find  and  the  approximation  is  normally  satisfaetory. 
(Conover,  1999,  pp.  204-205) 

This  test  was  applied  to  participant  responses  for  four  measures  of  accuracy. 
Each  measure  was  based  on  the  eorreet  identification  of  a  component  of  the  target 
message.  The  first  measure  eounted  eorreet  identifications  of  the  person  delivering  the 
message  (speaker).  The  seeond  measured  identifieation  of  the  first  part  of  the  coordinate 
(alpha)  while  the  third  measured  the  seeond  part  of  the  eoordinate  (numerie).  The  last 
measured  eorreet  identification  of  the  whole  eoordinate  (aggregate). 

At  a  .10  significance  level,  this  test  indicated  that  the  proportion  of  aceurate 
responses  was  dependent  on  spatialization  for  several  measures  of  accuraey.  These 
included  the  aggregate  eoordinate  measure  in  the  two  voiee  trials,  and  the  identification 
of  the  speaker,  alphabetieal  component,  and  numerie  eomponent  in  the  four  voice  trials. 
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It  is  important  to  note  two  things.  First,  the  aggregate  measure  was  not  examined  for  the 
four  voiee  trials  beeause  the  task  was  difficult  enough  that  there  were  no  responses  that 
correctly  identified  both  portions  of  the  coordinate.  Second,  the  test  indicated  that 
spatialization  and  accuracy  were  independent  for  the  speaker,  alpha  coordinate,  and 
numeric  coordinate  measures  under  the  two  voice  trials. 


2  voice  (correctly  identify  speaker) 


T  reated 

Untreated 

Correct 

251 

294 

545 

247.7 

297.3 

Incorrect 

49 

66 

115 

52.3 

62.7 

300 

360 

660 

2  voice  (correctly  identify  alphabetic  component  of  coordinate) 

T  reated 

Untreated 

^ij 

Correct 

229 

258 

487 

221.4 

265.6 

Incorrect 

71 

102 

173 

78.6 

94.4 

300 

360 

660 

2  voice  (correctly  identify  numeric  component  of  coordinate) 

T  reated 

Untreated 

^ij 

Correct 

231 

270 

501 

227.7 

273.3 

Incorrect 

69 

90 

159 

72.3 

86.7 

300 

360 

660 

2  voice  (correctly  identify  entire  coordinate) 

T  reated 

Untreated 

Correct 

220 

240 

460 

209.1 

250.9 

Incorrect 

80 

120 

200 

90.9 

109.1 

300 

360 

660 

T  p-value 

0.455  0.500 


1.842  0.175 


0.358  0.550 


3.443  0.064 


Figure  7.  Chi-squared  tests  for  2  voice  trials 
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4  voice  (correctly  identify  speaker) 


Treated 

Untreated 

^ij 

Correct 

178 

170 

348 

158.2 

189.8 

Incorrect 

122 

190 

312 

141.8 

170.2 

300 

360 

660 

4  voice  (correctly  identify  alphabetic  component  of  coordinate) 

Treated 

Untreated 

^ij 

Correct 

159 

115 

274 

124.5 

149.5 

Incorrect 

141 

245 

386 

175.5 

210.5 

300 

360 

660 

4  voice  (correctly  identify  numeric  component  of  coordinate) 

Treated 

Untreated 

^ij 

Correct 

154 

107 

261 

118.6 

142.4 

Incorrect 

146 

253 

399 

181.4 

217.6 

300 

360 

660 

T  p-value 

9.6295  0.0019 


29.8788  0.0000 


31.9675  0.0000 


Figure  8.  Chi-squared  tests  for  4  voice  trials 


This  approach  is  valuable  as  a  means  of  conducting  exploratory  analysis.  It 
presents  strong  evidence  that  accuracy  is  dependent  on  spatialization  with  four 
simultaneous  messages,  but  it  provides  little  evidence  that  the  same  relationship  exists 
with  only  two  messages.  One  of  the  problems  with  the  chi-squared  test,  however,  is  that 
it  is  generally  considered  a  procedure  of  low  power.  In  other  words,  there  is  an  increased 
chance  that  the  null  hypothesis  would  not  be  rejected,  even  if  it  should  be.  In  this  case 
there  is  a  possibility  that  dependence  exists  for  the  two-voice  condition,  but  the  test  failed 
to  detect  it. 

Another  form  of  analysis  is  valuable  for  two  reasons.  First,  it  would  provide  a 
second  opportunity  to  evaluate  the  results  of  the  trials  that  used  two  voices  at  a  time. 
Second,  a  test  that  can  quantify  the  impact  of  multiple  factors  could  ease  any  concerns 
that  a  confounding  variable  skewed  the  chi-squared  results  for  the  four  voice  trials. 
Given  the  extremely  low  p-values  for  those  tests,  it  is  unlikely  that  the  conclusion  will 
change,  but  it  would  still  be  interesting  to  quantify  the  relative  influence  of  spatialization 
along  with  other  variables  that  may  have  affected  the  probability  of  successful 
identification. 
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5,  Logit  Regression 


Linear  regression  is  frequently  used  to  fit  a  line  to  a  set  of  observations  that  can  be 
described  with  an  independent  and  dependent  variable.  If  the  dependent  values  are 
placed  on  the  y-axis  of  a  graph  and  the  independent  values  are  placed  on  the  x-axis,  then 
the  slope  and  intercept  of  the  line  can  be  used  to  describe  the  relationship  between  the 
two  variables.  Multiple  regression  allows  for  more  than  one  independent  variable  to  be 
used  in  the  same  type  of  equation.  This  approach  could  be  beneficial  for  exploring  the 
causal  relationship  between  a  measure  of  accuracy  and  multiple  predictors,  but  there  is  a 
complication.  If  accuracy  is  measured  as  a  binary  variable,  then  regression  would  simply 
fit  a  straight  line  through  two  groups  of  observations.  One  group  would  take  on  the  value 
of  zero  and  the  other  would  take  on  the  value  of  one.  A  slope  and  intercept  would  be 
generated,  but  they  would  not  form  a  good  fit  with  the  original  data.  Specifically,  any 
line  with  a  non-zero  slope  would  predict  y-values  that  were  less  than  zero,  or  greater  than 
one,  at  some  reasonable  x-value  (Hamilton,  1992,  p.220). 

In  order  to  form  a  line  that  fits  binary  data,  we  need  a  function  that  only  takes  on 
values  between  zero  and  one.  A  natural  function  to  use  in  this  type  of  situation  is  based 
on  the  probability  that  a  particular  observation  will  have  a  y-value  of  one.  Probabilities 
can  only  take  on  values  between  zero  and  one  and  they  have  a  useful  interpretation  for 
this  analysis.  Specifically,  an  equation  could  be  developed  that  would  predict  the 
probability  of  an  accurate  response  given  a  set  of  conditions  that  is  defined  by  the 
independent  variables.  In  other  words,  variables  such  as  spatialization,  trial  number,  and 
participant  number  could  be  used  to  predict  the  probability  of  an  accurate  response. 

If  the  probability  of  achieving  an  accurate  response  is  called  P,  then  the  odds  that 
a  response  variable  equals  one  is: 


0{Y  =  1)  =  — 
\-P 


(3.3) 
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Taking  the  natural  logarithm  of  this  expression  gives  the  log  odds  or  logit.  Logit 
regression  is  essentially  multiple  regression  with  the  logit  as  the  response  variable.  In  the 
following  equation,  the  logit  (L)  is  a  linear  function  of  the  independent  (x)  variables. 


L  -  Pq  +  A^l  +  ■■■  +  Pk-\^k-\ 


(3.4) 


Though  equation  3.4  is  a  linear  function,  converting  the  logit  to  a  probability  with 
equation  3.5  creates  a  non-linear  probability  function  with  values  between  zero  and  one. 
(Hamilton,  1992,  pp.220-221) 


P  = 


1 

l  +  e'^ 


(3.5) 


This  technique  can  be  accomplished  with  the  S-plus  statistical  package  by 
building  a  generalized  linear  model  (GLM)  based  on  the  binomial  family.  As  an 
example,  the  following  S-plus  output  shows  the  summary  for  a  logit  regression  model. 
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Call:  glm(formula  =  Alpha  ~  Participant  +  Trial  +  Spatialization,  family  =  binomial,  data 
=  Pilot . 4vall) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-1.378632  -0.9946176  -0.800052  1.146946  1.698117 


Coefficients : 

Value  Std.  Error  t  value 

(Intercept)  0.562489706  0.361589855  1.5556015 

Participant  -0.126599492  0.051937951  -2.4375142 

Trial  -0.003058066  0.004692248  -0.6517272 

Spatialization  0.791364437  0.167670520  |4 . 719759^ 

(Dispersion  Parameter  for  Binomial  family  taken  to  be  1  ) 

Null  Deviance:  895.8559  on  659  degrees  of  freedom 
Residual  Deviance:  859.4353  on  656  degrees  of  freedom 

Figure  9.  Logit  Regression.  Example  of  Coeffieient  Estimates 

This  model  estimates  the  logit  for  sueeessful  alphabetieal  eoordinate  identifieations  and 
uses  the  partieipant  number,  trial  number,  and  spatialization  as  predietors.  The  number  of 
voiees  is  not  used  beeause  the  model  was  built  only  on  the  data  from  the  four  voice  trials. 

Coefficient  estimates  for  these  types  of  models  show  the  direction  and  magnitude 
of  a  variable's  effect  on  the  log  odds  of  success.  The  high  positive  value  for  spatialization 
in  figure  9  suggests  that  it  had  a  positive  impact  on  the  chance  of  success.  The 
corresponding  t-value  can  be  used  to  test  the  hypothesis  that  the  true  value  of  the 
coefficient  is  zero.  Eor  eleven  degrees  of  freedom,  values  greater  than  2.20  or  less  than  - 
2.20  indicate  that  this  hypothesis  would  be  rejected  at  the  .05  significance  level.  In  this 
case,  the  t-value  for  spatialization  indicates  that  the  term  is  significant. 

An  important  consideration  with  any  type  of  statistical  model  is  how  well  it  fits 
the  actual  data.  Eor  a  logit  regression  model,  an  analysis  of  deviance  can  be  used  to 
determine  goodness  of  fit.  Eigure  10  shows  this  analysis  for  the  same  model  that  was 
presented  in  figure  9. 
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Analysis  of  Deviance 
Binomial  model 
Response:  Alpha 

Terms  added  sequentially  (first  to  last) 


Df 

Deviance  Resid.  Df 

Resid.  Dev 

Pr  (Chi) 

NULL 

659 

895 . 8559 

Participant 

1 

12.65796  658 

883.1980 

0 . 0003740 

Trial 

1 

0.40991  657 

882 . 7881 

0.5220169 

Spatialization 

1 

23.35274  656 

859.4353 

10.00000131 

Figure  10.  Logit  Regression.  Example  of  Analysis  of  Deviance. 

The  highlighted  p-value  indicates  that  this  model  would  be  considered  a  good  fit  at  the 
.05  significance  level.  It  is  important  to  emphasize  that  terms  were  added  to  the  model 
sequentially  and  the  p-value  on  a  particular  line  indicates  the  fit  of  a  model  based  on  that 
term  and  the  ones  above  it.  The  decision  to  remove  a  term,  however,  should  not  be  based 
solely  on  this  criterion. 

Similar  models  were  built  for  each  of  the  measures  of  accuracy  with  data  from 
both  the  two  voice  and  four  voice  trials.  Each  model  had  a  significant  positive  coefficient 
for  spatialization.  The  fit  of  the  models  varied  with  the  inclusion  of  certain  terms.  In 
general,  these  models  suggest  that  spatialization  had  a  quantifiable  impact  on  accuracy 
for  both  the  two  and  four  voice  conditions.  It  is  tempting  to  go  further  and  say  that  the 
variation  among  participants  and  between  trials  was  insignificant  compared  to  the  effect 
of  spatialization,  but  this  data  created  several  notable  limitations  for  the  regression 
models. 

Eirst,  both  trials  and  participants  were  originally  treated  as  continuous  variables. 
There  is  a  valid  interpretation  for  this  approach  because  both  variables  were  ordinal.  In 
other  words,  the  eighth  participant  in  the  experiment  participated  at  a  point  that  was  twice 
as  far  from  the  beginning  as  the  first.  Similarly,  the  eighth  trial  out  of  sixty  is  twice  as  far 
into  the  sequence  as  the  fourth.  The  problem  is  that  this  limits  the  type  of  differences  that 
can  be  explored,  particularly  between  participants.  Viewing  the  relationship  between 
trials  as  a  simple  linear  function  of  their  order  has  some  meaning,  but  this  is  less 
interpretable  for  participants.  The  problem  originated  in  the  design  of  the  pilot 
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experiment.  Sinee  some  partieipants  reeeived  spatialization  and  others  did  not, 
singularities  were  ereated  when  attempts  were  made  to  inelude  both  partieipants  and 
spatialization  in  the  model  as  faetors. 

Similarly,  the  relationship  between  partieipants  and  spatialization  led  to  a  high 
degree  of  eorrelation  between  the  two  variables,  even  when  the  partieipant  number  was 
treated  as  eontinuous.  This  raises  the  issue  of  multieollinearity,  whieh  ean  lead  to 
unreliable  eoeffieient  estimates  and  inflated  standard  deviations.  The  solution  to  both  of 
these  problems  was  to  eonduet  an  experiment  in  whieh  every  partieipant  reeeived  a 
eombination  of  spatialized  and  non-spatialized  trials. 
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IV.  FINAL  EXPERIMENT 


A,  METHODOLOGY 

1,  Hardware 

The  most  significant  change  to  the  hardware  configuration  was  the  addition  of  an 
inertial  head  tracker.  Specifically,  an  InterSense  InterTrax2  was  mounted  to  the  top  of 
the  participant's  headphones  and  connected  to  the  AuSim  server  via  a  USB  port.  This 
device  was  able  to  monitor  the  movement  of  the  participant's  head  with  three  degrees  of 
freedom  (yaw,  pitch,  and  roll).  An  AuSim  application,  called  the  AuSim  Asynchronous 
Tracking  Program  (AuAST)  was  used  to  feed  the  raw  data  to  Nordjorvik. 

One  of  the  disadvantages  to  headphone  spatialization  is  that  the  sound  sources 
move  with  the  head.  This  can  disrupt  the  illusion  of  spatialization  and  prevent  the 
resolution  of  front-back  confusion.  The  purpose  of  the  head  tracker  was  to  improve  the 
perception  of  localization  for  the  spatialized  trials. 

2.  Design  Changes 

Several  major  changes  were  made  to  the  design  of  the  pilot  study  experiment. 
One  of  the  most  significant  was  the  generation  of  a  new  script  that  contained  trials  with 
three  and  four  voices.  The  two-voice  condition  was  eliminated  for  two  reasons.  First,  an 
impression  was  formed  during  the  pilot  study  that  there  was  a  large  gap  between  the 
difficulty  of  two  and  four  voice  trials.  This  insight  was  supported  by  both  qualitative 
observations  from  participants  and  by  the  difference  in  average  accuracy  rates. 
Specifically,  the  two  voice  trials  seemed  very  easy  for  participants  after  they  had  learned 
to  focus  on  the  differences  between  the  voices. 

The  second  reason  for  eliminating  the  two-voice  condition  was  to  limit  the  length 

of  the  experiment.  The  natural  question  that  arose  from  the  differences  in  difficulty  was 

whether  three  voices  would  be  more  like  the  two  voices  or  more  like  four  voices.  The 
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problem  was  that  the  experiment  would  have  been  much  too  long  if  a  two,  three,  and  four 
voice  condition  were  all  used  at  the  same  time.  The  pilot  study  results  were  not 
conclusive,  but  they  suggested  that  this  experimental  design  would  ultimately  duplicate 
these  results  or  earlier  experiments  that  used  two  voices. 

Yankee  Two  Yankee  Three 


i 


Control 

Figure  1 1 .  Placement  of  sound  sources  with  three  speakers 

The  second  major  change  was  the  introduction  of  a  balanced  design  that  would 
require  each  participant  to  listen  to  a  combination  of  spatialized  and  non-spatialized 
trials.  Alterations  were  made  to  the  original  script  generator  to  include  the  addition  of 
three  voice  trials  and  to  add  a  flag  to  the  output  which  would  be  used  to  determine  if  a 
specific  trial  was  spatialized  or  not.  The  number  of  flags  insured  that  half  of  the  trials 
would  be  spatialized  and  they  were  applied  at  random  intervals  to  the  list  of  trials. 
Additionally,  the  random  ordering  was  structured  so  that  there  could  not  be  a  run  of  more 
than  six  trials  that  would  have  the  same  spatialization  condition. 

A  third  major  change  involved  the  use  of  a  new  normalization  method  to  equalize 
the  apparent  loudness  of  the  message  files.  One  observation  from  the  pilot  study  was  that 
the  peak  volume  method  had  not  adequately  compensated  for  volume  differences 
between  the  four  voices.  As  a  result,  a  more  comprehensive  method  was  applied  using 
the  root  mean  squared  (RMS)  intensity  over  the  entire  length  of  the  message.  All  sounds 
were  normalized  to  -12dB.  Scan  parameters  included  an  attack  time  of  10  milliseconds 
and  a  release  time  of  500  milliseconds.  Additionally,  portions  of  a  message  that  were 
under  a  threshold  of  -70dB  were  ignored  in  the  calculations. 
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Minor  changes  to  the  experimental  design  included  the  transfer  of  sound  files 
from  the  client  to  the  server.  Ruiming  Nordjorvik  from  the  server  reduced  the  latency 
from  the  RS-232  cable  and  helped  improve  synchronization  during  message  playback. 
Control  of  the  trial  progression  was  also  passed  to  the  experimenter.  This  produced  two 
benefits.  First,  there  was  less  chance  that  the  experimenter  would  become  confused  and 
run  the  wrong  trial.  Second,  the  participant  was  free  to  focus  on  responding  to  the 
messages.  The  last  set  of  minor  changes  included  several  revisions  to  the  data  collection 
form.  A  large  button  was  added  under  the  response  fields  to  advance  the  record.  A 
reminder  of  the  participant's  call  sign  and  an  admonition  to  focus  on  the  target  message 
were  displayed  on  the  form.  Two  diagrams  were  also  added  to  show  the  positions  of  the 
message  sources  for  the  spatialized  trials. 


Figure  12.  Screenshot  of  Response  Input  Form 

Finally,  an  orientation  and  short  set  of  practice  trials  were  added  in  the  hopes  of 
decreasing  learning  effects.  This  portion  included  an  opportunity  to  listen  to  each  of  the 
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speakers  separately,  an  example  of  three  speakers  with  and  without  spatialization, 
instruetions  for  new  hardware,  and  ten  practiee  trials.  The  praetiee  trials  were  divided 
evenly  between  three  and  four  voices. 

The  practice  session  was  followed  by  a  testing  period  that  was  very  similar  to  the 
pilot  study.  The  participant  would  read  the  record  number  and  the  experimenter  would 
load  the  corresponding  trial.  Next,  the  participant  would  listen  to  the  messages  and  enter 
a  response.  Finally,  the  participant  would  advance  the  record  and  read  the  new  record 
number.  Similar  to  the  pilot  study,  data  collection  consisted  of  120  trials.  The  first  sixty 
contained  three  voice  messages,  while  the  second  60  contained  four  voice  messages. 

3.  Participants 

Participants  included  two  women  and  twenty- three  men.  The  majority  was  active 
duty  military,  though  three  participants  were  civilians.  All  participants  were  over  the  age 
of  18  and  had  completed  at  least  a  bachelor's  degree.  None  of  the  participants  reported 
hearing  abnormalities. 


B,  ANALYSIS 

1.  Qualitative  Observations 

Many  attempts  were  made  to  isolate  the  effect  of  spatialization  on  response 
accuracy.  These  included  the  elimination  of  the  RS-232  client-server  connection,  the 
application  of  RMS  normalization,  and  the  addition  of  practice  trials.  Despite  these 
efforts  there  were  anecdotal  reasons  to  believe  that  differences  between  voices,  trials,  and 
participants  continued  to  have  an  impact  on  accuracy  rates. 

The  voice  that  delivered  the  target  message  appeared  to  be  important  in  two  ways. 

First,  participants  continued  to  claim  that  some  voices  were  more  intelligible  than  others. 

This  appeared  to  be  due  to  their  position  in  space  rather  than  the  actual  intensity  of  the 

source  files.  Both  of  these  voices  were  placed  to  the  sides  and  slightly  behind  the  listener 
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in  the  spatialized  trials.  Specifically,  "Yankee  Two"  was  placed  at  225  degrees  and 
"Yankee  Three"  was  placed  at  315  degrees.  Similarly,  some  participants  claimed  that 
they  had  a  hard  time  hearing  the  voice  for  "Control"  in  the  three  voice  trials  when  that 
voice  was  placed  directly  behind  them  (270  degrees). 

The  second  issue  with  target  voices  was  related  to  the  problem  of  message 
synchronization.  Even  though  changes  to  the  hardware  configuration  had  improved  the 
amount  of  overlap  between  messages,  there  were  still  instances  where  one  voice  could  be 
heard  distinctly  by  itself.  Sometimes  this  happened  purely  by  accident.  One  source 
would  be  speaking  while  the  other  two  or  three  were  pausing.  Other  times,  however,  the 
there  would  be  a  short  pause  between  the  start  of  the  first  voice  and  the  addition  of 
subsequent  voices.  During  the  pilot  study,  this  type  of  variation  was  examined  as  part  of 
the  trial-to-trial  changes  in  the  probability  of  success.  In  the  final  experiment,  a  decision 
was  made  to  specifically  analyze  the  effect  of  the  target  voices. 

Differences  among  participants  were  expected,  but  there  was  one  type  of 
difference  that  appeared  to  be  significant.  Some  participants  seemed  to  make  effective 
use  of  the  head  tracker,  while  others  did  not.  Assuming  that  a  listener  could  identify  the 
speaker  that  had  addressed  their  call  sign,  it  was  possible  to  focus  on  that  message  by 
turning  an  ear  toward  the  corresponding  position.  For  example,  if  a  participant  heard 
"Control"  call  them  in  the  three  voice  trials,  the  rest  of  the  message  would  become  more 
intelligible  if  they  turned  their  head  toward  their  rear.  Anecdotally,  some  participants 
seemed  to  acquire  this  skill  quickly  and  use  it  to  great  effect.  Many  did  not  attempt  to 
use  it  at  all  and  a  handful  seemed  to  become  confused  when  they  used  it.  These 
differences  were  not  anticipated  and  there  is  no  way  to  analyze  them  specifically  from  the 
data  that  was  collected.  The  best  approximation  that  could  be  made  was  to  study  the 
effect  that  the  participant  variable  had  on  accuracy. 

2,  Descriptive  Statistics 

At  first  glance,  differences  in  the  proportion  of  correct  responses,  conditioned  on 
spatialization,  appear  significant.  Figure  13  provides  this  data  in  a  tabular  format. 
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followed  by  three  charts  that  give  the  same  information  with  bar  charts.  The 
abbreviations  represent  the  four  measures  of  accuracy  from  the  pilot  study;  speaker 
identification  (Speak),  alphabetical  coordinate  identification  (Alpha),  numerical 
coordinate  identification  (Num),  and  identification  of  the  whole  coordinate  (Agg).  In 
addition,  there  is  a  fifth  measure  for  total  accuracy.  This  variable  was  recorded  as  a  one 
if  all  parts  of  the  message  were  identified  correctly  and  zero  if  any  of  the  parts  were 
missed.  It  is  referred  to  as  total,  or  complete,  accuracy. 


All  Data 

Speak 

Alpha 

Num 

Agg 

Total 

Spatialized 

0.59 

0.51 

0.49 

0.45 

0.43 

Non-Spatialized 

0.41 

0.25 

0.29 

0.19 

0.17 

3  voice 

Speak 

Alpha 

Num 

Agg 

Total 

Spatialized 

0.66 

0.58 

0.56 

0.52 

0.51 

Non-Spatialized 

0.51 

0.30 

0.37 

0.26 

0.24 

4  voice 

Speak 

Alpha 

Num 

Agg 

Total 

Spatialized 

0.51 

0.43 

0.42 

0.37 

0.36 

Non-Spatialized 

0.32 

0.21 

0.22 

0.13 

0.10 

Figure  13.  Summary  Statistics 
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Comparison  of  Accuracy  Rates  (All  Data) 


lOSpatialized  HNon-Spatialized 


Figure  14.  Comparison  of  Accuracy  Rates  (All  Data) 


Comparison  of  Accuracy  Rates  (4  Voices) 


lOSpatialized  ■Non-Spatialized 


Figure  15.  Comparison  of  Accuracy  Rates  (4  Voices) 
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Comparison  of  Accuracy  Rates  (3  Voices) 


IPSpatialized  BNon-Spatialized 


Figure  16.  Comparison  of  Accuracy  Rates  (3  Voices) 

Visually,  these  differences  appear  to  be  notable,  but  it  is  important  to  test  their 
significance  statistically.  An  approach  similar  to  the  one  found  in  chapter  3  was  utilized 
with  an  expectation  that  the  new  data  would  provide  more  definitive  results.  This 
assumption  was  based  on  in  increase  in  the  number  of  participants  and  the  change  to  a 
balanced  design  in  which  each  participant  received  both  spatialized  (treated)  and  non- 
spatialized  (untreated  trials). 

3,  Chi-squared  Tests  for  Independence 

The  results  of  chi-squared  tests,  applied  to  both  the  three  and  four  voice  data, 
indicated  very  strong  evidence  for  the  dependent  relationship  between  accuracy  and 
spatialization.  Every  p-value  was  smaller  than  .0001,  a  threshold  that  far  exceeds  any 
reasonable  test  of  significance.  These  results  were  most  likely  the  result  of  two  factors. 
First,  there  seems  to  be  a  genuine  difference  that  is  attributable  to  spatialization.  Second, 
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a  large  amount  of  data  was  used.  Twenty  five  partieipants  might  not  seem  like  a  large 
sample  size,  but  the  chi-squared  test  was  based  on  the  results  of  individual  trials.  This 
means  that  each  test  was  able  to  utilize  1500  observations.  Figures  17  and  18  present  the 
results  of  this  analysis. 


3  voice  (correctly  identify  all  components) 


T  reated 

Untreated 

Correct 

380 

178 

558 

Incorrect 

370 

572 

942 

750 

750 

1500 

3  voice  (correctly  identify  speaker) 

T  reated 

Untreated 

Correct 

496 

384 

880 

Incorrect 

254 

366 

620 

750 

750 

1500 

3  voice  (correctly  identify  whole  coordinate) 

T  reated 

Untreated 

Correct 

392 

192 

584 

Incorrect 

358 

558 

916 

750 

750 

1500 

3  voice  (correctly  identify  alpha  coordinate) 

T  reated 

Untreated 

Correct 

438 

223 

661 

Incorrect 

312 

527 

839 

750 

750 

1500 

3  voice  (correctly  identify  numeric  coordinate) 

T  reated 

Untreated 

Correct 

423 

274 

697 

Incorrect 

327 

476 

803 

750 

750 

1500 

T 

p-value 

279.0 

279.0 

116.4418 

0.0000 

471.0 

471.0 

T 

p-value 

440.0 

440.0 

34.4868 

0.0000 

310.0 

310.0 

T 

p-value 

292.0 

292.0 

112.1613 

0.0000 

458.0 

458.0 

T 

p-value 

330.5 

330.5 

125.0273 

0.0000 

419.5 

419.5 

Eij 

T 

p-value 

348.5 

348.5 

59.4998 

0.0000 

401.5 

401.5 

Figure  17. 


Chi-squared  analysis  for  3  voice  trials 
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4  voice  (correctly  identify  all  components) 


Treated 

Untreated 

T 

p-value 

Correct 

271 

72 

343 

171.5 

171.5 

149.6821 

0.0000 

Incorrect 

479 

678 

1157 

578.5 

578.5 

750 

750 

1500 

4  voice  (correctly  identify  speaker) 

Treated 

Untreated 

T 

p-value 

Correct 

386 

238 

624 

312.0 

312.0 

60.1071 

0.0000 

Incorrect 

364 

512 

876 

438.0 

438.0 

750 

750 

1500 

4  voice  (correctly  identify  whole  coordinate) 

Treated 

Untreated 

T 

p-value 

Correct 

280 

100 

380 

190.0 

190.0 

114.1917 

0.0000 

Incorrect 

470 

650 

1120 

560.0 

560.0 

750 

750 

1500 

4  voice  (correctly  identify  alpha  coordinate) 

Treated 

Untreated 

In 

T 

p-value 

Correct 

325 

158 

483 

241.5 

241.5 

85.1640 

0.0000 

Incorrect 

425 

592 

1017 

508.5 

508.5 

750 

750 

1500 

4  voice  (correctly  identify  numeric  coordinate) 

Treated 

Untreated 

In 

T 

p-value 

Correct 

312 

168 

480 

240.0 

240.0 

63.5294 

0.0000 

Incorrect 

438 

582 

1020 

510.0 

510.0 

750 

750 

1500 

Figure  18.  Chi-squared  analysis  for  4  voiee  trials 


The  prineipal  limitation  to  this  analysis  is  the  simplieity  of  the  results.  Though  it 
supports  the  argument  that  spatialization  improves  performanee,  there  is  mueh  more  that 
ean  be  done  with  the  wealth  of  data  that  was  eolleeted  from  the  final  experiment.  Again, 
regression  provides  an  opportunity  to  examine  the  effeet  of  other  variables.  Even  better, 
coeffieients  based  on  log  odds  have  a  natural  interpretation  as  the  amount  that  a  faetor 
ehanges  the  probability  of  sueeess. 
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4.  Logit  Regression 


The  pilot  study  was  structured  to  determine  if  learning,  fatigue,  or  other  factors 
that  affected  the  success  rate  were  present.  This  structure  confirmed  that  these  types  of 
effects  existed,  but  it  presented  difficulties  when  attempting  to  confirm  the  effect  of 
spatialization.  In  contrast,  the  final  experiment  was  based  on  a  more  balanced  design. 
The  resulting  data  proved  to  be  more  conducive  for  focusing  on  the  effect  of 
spatialization. 

One  specific  advantage  was  the  ability  to  change  the  participant  variable  to  a 
factor  with  24  levels.  In  chi-square  analysis  for  independence  in  the  pilot  study,  the  test 
only  took  one  predictor  variable  into  account  and  indicated  that  spatialization  was  not 
significant  for  the  two  voice  trials.  The  logit  regression  model  used  a  greater  number  of 
variables,  albeit  imperfectly,  and  suggested  that  spatialization  was  a  significant  predictor 
of  success. 

An  example  of  this  problem  was  also  encountered  with  the  data  from  the  final 
experiment.  Figure  19  shows  a  logit  regression  model  with  three  variables  used  as 
predictors.  Spatialization,  called  "Treat”,  is  shown  as  having  a  significant  positive  effect 
in  the  presence  of  voices  and  trials.  In  this  case,  “voices”  was  a  factor  with  two  levels 
and  “trials”  was  an  ordinal  variable.  An  analysis  of  deviance  showed  that  the  model 
passed  the  goodness  of  fit  test  with  a  p-value  that  was  considerably  smaller  than  .01,  but 
there  were  several  problems  with  the  model.  First,  it  was  important  to  see  if  the  sign  or 
standard  deviation  of  the  coefficient  estimates  would  change  in  the  presence  of  other 
variables.  Second,  a  large  change  in  the  magnitude  of  the  coefficient  for  spatialization 
could  be  important.  Figure  20  shows  a  more  complicated  model  that  included  both 
participants  and  the  target  voice  (source)  as  factors.  Note  that  the  Treat  variable 
maintained  a  significant,  positive  coefficient  estimate,  but  the  magnitude  was  different. 
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Call:  glm ( formula  =  Speak  ~  Voice  +  Treat  +  Trial,  family  =  binomial,  data  =  Final. Data) 
Deviance  Residuals : 

Min  IQ  Median  3Q  Max 

-1,593513  -1.138687  0.812157  1.137074  1.578598 

Coefficients : 

Value  Std.  Error  t  value 
(Intercept)  -0.430436596  0.136845816  -3.145413 
Voice  -0.573490250  0.075988839  -7.547033 
Treat  0.364244018  0.037695658  9.662758 

Trial  0.007209083  0.002175212  3.314197 

(Dispersion  Parameter  for  Binomial  family  taken  to  be  1  ) 

Null  Deviance:  4158.862  on  2999  degrees  of  freedom 

Residual  Deviance:  3966.704  on  2996  degrees  of  freedom 

Number  of  Fisher  Scoring  Iterations:  2 


Figure  19.  Logit  Regression.  Model  with  Three  Predietors 


Call:  glm ( formula  =  Speak  ~  Voice  +  Treat  +  Trial  +  Participant  +  Source,  family  = 
binomial,  data  =  Final. Data) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.515075  -0.8493125  0.2322847  0.8331919  2.634168 


Coefficients : 

(Intercept)  -0. 

Voice  -0. 

Treat  0. 

Trial  0. 
Participant! 
Participant 2 
Participant! 
Participant! 
Participant5 
Participant  6 
Participant! 
Participant! 
Participant9 
Participant 10 
Participant  11 
Participant 12 
Participant 13 
Participant  14 
Participant  15 
Participant 16 
Participant 17 
Participant 18 
Participant 19 
Participant 20 
Participant 21 
Participant 2 2 
Participant 2 3 
Participant!! 

Sourcel  -1. 

Source!  0 . 

Source!  -0. 


Value  Std.  Error  t  value 

662312045  0.159592351  -4.1500237 

584496117  0.090429166  -6.4635796 

546746939  0.046128558  11.8526778 

008392205  0.002505463  3.3495627 

0.844521653  0.158073592  -5.3425853 

0.115305538  0.086253435  1.3368226 

0.239956798  0.067879033  -3.5350651 

0.016192190  0.047845969  0.3384233 

0.236279194  0.038637267  6.1153186 

0.078740054  0.031752741  2.4797876 

0.171294716  0.028803175  5.9470775 

0.143554177  0.025645789  5.5975730 

0.074446979  0.022026796  3.3798369 

0.070547162  0.020534014  -3.4356245 

0.147175569  0.020944305  7.0269972 

0.103798729  0.018595667  -5.5818771 

0.068753433  0.015867493  4.3329740 

0.087622545  0.016038237  -5.4633526 

0.078994544  0.014329410  5.5127562 

0.042591720  0.012746497  3.3414452 

0.042768872  0.012111301  3.5313193 

0.070397173  0.012462648  -5.6486528 

0.056066687  0.011302528  4.9605439 

0.050934874  0.010793367  -4.7190905 

0.048557049  0.010182409  4.7687192 

0.042277350  0.009665747  4.3739349 

0.048274888  0.009487342  -5.0883470 

0.022976518  0.008509901  2.6999747 

064906148  0.084799400  -12.5579443 
009662149  0.038256846  0.2525600 

200650780  0.026219696  -7.6526739 


Residual  Deviance:  3157.748  on  2969  degrees  of  freedom 


Figure  20.  Logit  Regression.  Model  with  Thirty  Predictors. 
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The  models  in  figures  19  and  20  suggest  that  spatialization  increased  the  chance 
of  success,  but  there  was  a  second  problem  with  this  approach.  Similar  to  the  issue  with 
the  pilot  data,  where  participant  and  spatialization  were  highly  correlated,  voice  and  trial 
were  highly  correlated  in  the  final  data.  The  reason  is  that  the  four  voice  trials  always 
came  after  the  three  voice  trials.  The  problem  with  this  relationship  is  that  it  introduced 
the  potential  of  multicollinearity  again.  The  solution  was  to  build  models  on  subsets  of 
the  data.  One  group  used  the  data  from  the  three  voice  trials  and  the  other  group  used 
data  from  the  four  voice  trials.  Additionally,  a  new  variable  was  added  to  turn  Trial  into 
a  factor.  Instead  of  using  60  levels,  the  new  variable,  "Stage",  had  12  levels.  The  first 
level  corresponded  to  the  first  five  trials,  the  second  level  represented  trials  six  through 
ten,  and  so  on. 

Figure  21  shows  the  partial  results  of  a  logit  regression  model  that  used 
spatialization  (Treat),  trials  (Stage),  target  voice  (Source)  and  participants  as  factors. 


Call:  glm(formula  =  Alpha  ~  Treat  +  Stage  +  Participant  +  Source,  family  = 
binomial,  data  =  fSvall) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.566268  -0.6755575  -0.1975927  0.6615144  3.235951 


Coefficients : 

(Intercept ) 
Treat 
Stagel 


Value  Std.  Error 
-0.499155389  0.07653958 
1.263212777  0.09485824 
-0.259662770  0.17957489 


t  value 
-6.5215328 
13.3168482 
-1.4459860 


Stage9 

StagelO 

Stagel 1 

Participant! 

Participant2 

Participants 

Participant4 

Participants 

Participants 

Participant! 

Participants 

Participants 

Participant 10 


0.081708106 
0 .004421301 
0 .045472721 
1 . 037291766 
0 . 137001144 
0.423645895 
0.157889550 
0.298009968 
0.086177557 
0 .152941999 
0.238028131 
0 .110452715 
0.177333609 


0 . 02761867 
0 . 02400394 
0 . 02048126 
0.24537299 
0 . 12994851 
0.12306863 
0.07069623 
0.05735961 
0 .04715274 
0.04087090 
0.03989194 
0.03248956 
0.03823750 


2 . 9584370 
-0 . 1841907 
2.2202111 
-4.2274081 
1 . 0542725 
-3.4423550 
2.2333518 
5.1954673 
1 . 8276258 
3 .7420759 
5.9668227 
3.3996369 
-4 . 6376878 


Participant 2 4 

Sourcel 

Source2 


0.094421456  0.01480635 
-0.234314454  0.09405247 
-0.425853223  0.06000716 


6.3770905 
-2 .4913164 
-7 .0967073 


Figure  21 .  Logit  Regression.  Alpha  Response  Accuracy  (3  voices,  partial  output) 
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This  model  suggests  that  spatialization  had  a  large  positive  effect  on  the  ability  to 
accurately  identify  the  alphabetical  portion  of  a  coordinate  in  the  three  voice  trials.  In 
this  particular  case,  it  even  had  the  coefficient  with  the  greatest  absolute  value.  Also, 
note  the  large  t-value  for  "Treat".  Similar  to  the  results  of  the  chi-squared  analysis,  this 
corresponds  to  a  p-value  that  is  very  close  to  zero.  Figure  22  shows  that  this  model  also 
passed  the  goodness  of  fit  test. 


Terms  added  sequentially  (first  to  last) 


Df 

Deviance 

Res id.  Df 

Resid . 

Dev 

Pr (Chi) 

NULL 

1499 

2058 

.269 

Treat 

1 

126  . 

,  9351 

1498 

1931 

.334 

0. 

.  000000 

00 

Stage 

11 

20  . 

,  4466 

1487 

1910 

.  887 

0. 

.  03957924 

Participant 

24 

553. 

,  1791 

1463 

1357 

.708 

0. 

.  000000 

00 

Source 

2 

61 . 

,  4782 

1461 

1296 

.230 

0. 

.  000000 

00 

Figure  22.  Analysis  of  Deviance.  Alpha  Response  Accuracy  (3  voices) 

It  is  important  to  mention  that  this  is  also  the  first  model  that  lacked  coefficients 
that  were  highly  correlated.  It  does  not  answer  every  possible  question  that  could  be 
asked  with  this  type  of  experiment,  but  it  captures  the  important  aspects  of  the  data  that 
were  collected.  Unlike  simpler  models  it  is  capable  of  showing  the  effect  of 
spatialization  in  the  presence  of  other  variables.  Most  importantly,  it  was  applied  to  all  of 
the  measures  of  accuracy  for  both  the  three  and  four  voice  trials  with  similar  results. 
Table  2  provides  a  point  estimate  for  the  coefficient  of  the  "Treat"  variable,  the  standard 
error  for  the  estimate,  the  corresponding  t-value  for  the  estimate,  and  the  status  of  the 
goodness  of  fit  from  the  analysis  of  deviance. 

The  full  output  from  these  models  is  included  in  Appendix  I.  The  coefficients  of 
other  variables  might  be  of  some  interest.  In  general,  the  variation  between  participants 
is  expected  and  the  presence  of  significant  coefficients  is  not  a  surprise.  The  results  for 
voices,  however,  is  notable  because  it  indicated  that  a  trial  was  easier  or  harder  depending 
on  the  voice  that  delivered  the  message.  Finally,  the  stage,  or  progression  through  the 
trials,  did  not  appear  to  have  a  large  effect.  There  were  some  exceptions,  but  the 
coefficients  for  the  levels  of  the  stage  factor  tended  to  be  either  insignificant  or 
significant  and  small.  This  is  important  because  it  shows  that  even  if  learning,  fatigue,  or 
other  effects  are  present,  their  impact  is  normally  small  compared  to  other  factors.  It  is 
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also  worthwhile  to  repeat  the  observation  that  spatialization  proved  to  be  significant,  even 
in  the  presence  of  these  other  factors  that  influenced  the  probability  of  success. 


Measure 

Effect  of  spatialization  on 
log  odds  of  success 
(estimate) 

Standard 

Error 

of  estimate 

T- value 

(Hq:  Effect 
equals  zero) 

Goodness  of  Eit 

(a=.01) 

3  Voice 

Speaker 

+0.7760 

0.0837 

9.2639 

Passed 

(reject) 

Alpha 

+1.2632 

0.0949 

13.3168 

Passed 

(reject) 

Numeric 

+0.8536 

0.0855 

9 . 9872 

Passed 

(reject) 

Aggregate 

+1.3681 

0.1046 

13.0804 

Passed 

(reject) 

Total 

+  1 .4491 

0.1101 

13.1555 

Passed 
(reject ) 

4  Voice 

Speaker 

+0.5965 

0.0676 

8 . 8251 

Passed 

(reject) 

Alpha 

+  0 .8797 

0.0795 

11.0620 

Passed 

(reject) 

Numeric 

+0.7085 

0.0733 

9  .  6664 

Passed 

(reject) 

Aggregate 

+  1 .1712 

0.0968 

12 .1030 

Passed 

(reject) 

Total 

+  1 . 6405 

0 . 1277 

12 .8431 

Passed 

(reject) 

Table  3 .  Results  of  Logit  Regression 


The  information  from  Table  2  can  be  used  to  present  these  results  in  a  more 
intuitive  format.  First,  the  point  estimate  and  standard  error  can  be  used  to  form  a  99% 
confidence  interval.  Second,  the  treatment's  contribution  to  the  log  odds  of  success  can 
be  converted  into  a  probability.  Note,  however,  that  the  resulting  probability  assumes  a 
base  rate  of  50%.  This  is  because  the  response  variable  is  binary  and  there  would  be  a 
50%  probability  of  success  if  there  were  no  influences  other  than  chance.  Therefore,  a 
variable  with  a  coefficient  of  zero  has  no  effect  on  the  base  chance  of  success  in  a  logit 
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regression  model.  Variables  with  positive  coefficients  raise  the  probability  above  50%. 
Variables  with  negative  coefficients  lower  the  probability  below  50%. 

For  example,  the  term  for  spatialization  in  the  three  voice  trials,  with  the  alpha 
coordinate  response,  had  a  coefficient  of  1.2632.  Using  equation  3.5,  this  number  can  be 
converted  into  a  probability  of  .78.  One  interpretation  of  this  result  is  that  spatialization 
raised  the  chance  of  success  by  28%,  given  the  presence  of  the  other  conditions  that  were 
reflected  in  the  model. 

Table  3  presents  the  spatialization  coefficient  estimate  and  a  99%  confidence 
interval  based  on  the  student  t-distribution  with  1461  degrees  of  freedom  for  the  three 
voice  measures  and  1460  for  the  four  voice  measures.  It  also  shows  a  conversion  of  these 
results  into  changes  in  the  probability  of  success. 


Measure 

Effect  of 
spatialization 
on  log  odds  of 
success 
(estimate) 

99%  Confidence 
Interval  for  log 
odds 

Effect  of 
spatialization 
on  probability 
of  success 
(estimate) 

99%  Confidence 
Interval  for 
probability 

3  Voice 

Low 

High 

Low 

High 

Speaker 

+0.7760 

+0.5601 

+0 . 9919 

+  18 . 48% 

+13.65% 

+22 . 95% 

Alpha 

+1.2632 

+1.0184 

+1.5080 

+27 . 96% 

+23.47% 

+31.88% 

Numeric 

+0.8536 

+0 . 6331 

+1.0741 

+20 . 13% 

+15.32% 

+  24 . 54% 

Aggregate 

+1.3681 

+1 .0983 

+1 . 6379 

+29.71% 

+24 . 99% 

+33 . 72% 

Total 

+  1 .4491 

+1 .1651 

+1 . 7331 

+30 . 99% 

+26.23% 

+34 . 98% 

4  Voice 

Low 

High 

Low 

High 

Speaker 

+0.5965 

+  0 . 4222 

+0 . 7708 

+14.49% 

+10 .40% 

+18.37% 

Alpha 

+  0 .8797 

+  0  .  6747 

+1 . 0847 

+20 . 68% 

+16.25% 

+  24 .74% 

Numeric 

+0.7085 

+0.5195 

+0 .8975 

+  17 . 01% 

+12 .70% 

+21.04% 

Aggregate 

+  1 .1712 

+0 . 9215 

+1.4209 

+26 . 34% 

+21 . 54% 

+30.55% 

Total 

+  1 . 6405 

1.3111 

+1 . 9699 

+33.76% 

+28 .77% 

+37.76% 

Table  4.  Confidence  Intervals  for  Log  Odds  and  Probabilities  of  Success 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A,  ANALYTICAL  CONCLUSIONS 


This  research  provides  quantitative  evidence  that  a  spatialized  headphone  display 
can  increase  a  listener’s  probability  of  accurately  responding  to  more  than  two 
overlapping  messages.  Specifically,  a  chi-squared  analysis  of  experimental  data  strongly 
supports  the  dependent  relationship  between  accurate  responses  and  spatialization. 
Additionally,  the  coefficient  for  spatialization  in  a  logit  regression  model  reinforces  this 
conclusion  and  allows  for  the  impact  of  this  benefit  to  be  quantified  in  terms  of  increases 
in  the  probability  of  success.  The  first  half  of  this  conclusion  could  have  been  assumed 
from  prior  experiments,  but  such  an  assumption  would  have  required  important 
environmental  conditions  to  be  ignored. 

In  particular,  the  inclusion  of  more  than  two  voices  reduces  the  degrees  of 
separation  that  can  exist  between  any  two  sources.  Without  adequate  separation  the 
apparent  positions  of  two  nearby  sources  could  become  indistinguishable.  There  was 
some  concern  that  this  might  be  the  case  with  four  spoken  messages.  The  distinction 
between  the  left  and  right  ear  was  obviously  noticeable,  but  there  was  a  possibility  that  it 
would  be  difficult  to  separate  the  two  voices  that  were  on  the  same  side  of  the  head. 
Despite  the  relative  difficulty  of  attending  to  four  messages,  the  spatialization  scheme 
proved  to  be  beneficial. 


B,  RECOMMENDATIONS  FOR  FUTURE  STUDY 

Anecdotally,  the  effective  use  of  an  inertial  head  tracker  seemed  to  greatly 
improve  the  intelligibility  of  the  target  coordinate.  One  possibility  for  future  study  would 
be  to  compare  the  accuracy  of  a  participant's  responses  with  and  without  the  tracker. 
The  use  of  an  inertial  headtracker  is  significant,  since  the  device  is  relatively  inexpensive 
and  is  unaffected  by  metal  structures  as  are  more  traditional  electromagnetic 
headtrackers. 
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Another  area  for  potential  researeh  is  the  use  of  individualized  head  related 
transfer  functions.  These  measurements  can  improve  the  realism  of  localization 
perception  and  could  theoretically  have  an  impact  on  performance.  Similar  to  the  head 
tracking  issue,  the  benefit  of  custom  HRTFs  could  be  examined  by  using  them  as  a 
treatment  effect. 

Another  logical  extension  of  this  study  might  involve  the  use  of  additional  voices. 
At  the  least,  some  criteria  should  be  established  to  determine  what  constitutes  a 
minimally  acceptable  accuracy  level.  It  is  reasonable  to  conjecture  that  there  is  a  point  at 
which  spatialization  still  provides  a  benefit,  but  that  intelligibility  is  so  low  that  the 
situation  has  no  practical  applicability. 

It  is  also  important  to  note  that  these  same  questions  could  be  applied  using  some 
new  measure  of  performance.  Reaction  time  is  an  example  of  a  response  variable  that 
could  be  used  to  explore  more  subtle  difference  because  it  is  measured  on  a  continuous 
scale.  Care  should  be  taken  however,  not  to  misrepresent  the  differences  in  these  types  of 
studies.  Performance  decreases  measured  in  fractions  of  a  second  might  be  statistically 
significant,  but  they  might  not  be  meaningful  in  practical  terms. 

Finally,  the  development  of  context  specific  tests  could  be  beneficial  at  this  point. 
Certain  tasks,  such  as  head  tracking  might  be  more  practical  in  some  environments  and 
less  practical  in  others.  It  would  also  be  interesting  to  test  the  efficacy  of  a  spatialized 
sound  display  in  combination  with  a  visual  component  that  indicates  who  a  speaker  is 
addressing  or  even  the  full  text  conversion  of  speech. 
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APPENDIX  A.  MESSAGES 


This  appendix  contains  the  file  names  and  contents  of  the  messages  that  were  used  for 
both  the  pilot  study  and  final  experiment. 


Speaker  One  (Control) 

Target  Messages  (2  source  trials) 

File _ Message _ 

2101. wav  "Yankee  One,  this  is  control. 

2102. wav  "Yankee  One,  this  is  control. 

2103. wav  "Yankee  One,  this  is  control. 

2104. wav  "Yankee  One,  this  is  control. 

2105. wav  "Yankee  One,  this  is  control. 

2106. wav  "Yankee  One,  this  is  control. 

2107. wav  "Yankee  One,  this  is  control. 

2108. wav  "Yankee  One,  this  is  control. 

2109. wav  "Yankee  One,  this  is  control. 

21 10.  wav  "Yankee  One,  this  is  control. 

2111  .wav  " Y ankee  One,  this  is  control. 

21 12. wav  "Yankee  One,  this  is  control. 

21 13. wav  "Yankee  One,  this  is  control. 

21 14. wav  "Yankee  One,  this  is  control. 

21 15. wav  "Yankee  One,  this  is  control. 

21 16. wav  "Yankee  One,  this  is  control. 

21 17. wav  "Yankee  One,  this  is  control. 

21 18. wav  "Yankee  One,  this  is  control. 

21 19. wav  "Yankee  One,  this  is  control. 

2120. wav  "Yankee  One,  this  is  control. 

2121. wav  "Yankee  One,  this  is  control. 

2122. wav  "Yankee  One,  this  is  control. 

2123. wav  "Yankee  One,  this  is  control. 

2124. wav  "Yankee  One,  this  is  control. 

2125. wav  "Yankee  One,  this  is  control. 

2126. wav  "Yankee  One,  this  is  control. 

2127. wav  "Yankee  One,  this  is  control. 

2128. wav  "Yankee  One,  this  is  control. 

2129. wav  "Yankee  One,  this  is  control. 

2130. wav  "Yankee  One,  this  is  control. 


Proceed  to  position  Alpha  One.  Over" 
Proceed  to  position  Bravo  Two.  Over" 
Proceed  to  position  Charlie  Three.  Over" 
Proceed  to  position  Delta  Four.  Over" 
Proceed  to  position  Echo  Five.  Over" 
Proceed  to  position  Foxtrot  Six.  Over" 
Proceed  to  position  Golf  Seven.  Over" 
Proceed  to  position.  Hotel  Eight.  Over" 
Proceed  to  position.  Alpha  Two.  Over" 
Proceed  to  position  Bravo  Three.  Over" 
Proceed  to  position  Charlie  Pour.  Over" 
Proceed  to  position  Delta  Pive.  Over" 
Proceed  to  position  Echo  Six.  Over" 
Proceed  to  position  Poxtrot  Seven.  Over" 
Proceed  to  position  Golf  Eight.  Over" 
Proceed  to  position  Hotel  One.  Over" 
Proceed  to  position  Alpha  Three.  Over" 
Proceed  to  position  Bravo  Pour.  Over" 
Proceed  to  position  Charlie  Pive.  Over" 
Proceed  to  position  Delta  Six.  Over" 
Proceed  to  position  Echo  Seven.  Over" 
Proceed  to  position  Poxtrot  Eight.  Over" 
Proceed  to  position  Golf  One.  Over" 
Proceed  to  position  Hotel  Two.  Over" 
Proceed  to  position  Alpha  Pour.  Over" 
Proceed  to  position  Bravo  Pive.  Over" 
Proceed  to  position  Charlie  Six.  Over" 
Proceed  to  position  Delta  Seven.  Over" 
Proceed  to  position  Echo  Eight.  Over" 
Proceed  to  position  Poxtrot  One.  Over" 
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Speaker  One  (Control) 

Distracter  Messages  (2  source  trials) 

File _ Message _ 

2131. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Alpha  One. 

Over" 

2132. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Bravo  Two. 

Over" 

2133. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Charlie 

Three.  Over" 

2134. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Delta  Four. 

Over" 

2135. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Echo  Five. 

Over" 

2136. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Foxtrot  Six. 

Over" 

2137. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Golf  Seven. 

Over" 

2138. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position.  Hotel 

Eight.  Over" 

2139. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position.  Alpha 

Two.  Over" 

2140. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Bravo 

Three.  Over" 

2141. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Charlie 

Eour.  Over" 

2142. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Delta  Eive. 

Over" 

2143. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Echo  Six. 

Over" 

2144. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Eoxtrot 

Seven.  Over" 

2145. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Golf  Eight. 

Over" 

2146. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Hotel  One. 

Over" 

2147. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Alpha 

Three.  Over" 

2148. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Bravo  Eour. 

Over" 

2149. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Charlie 

Eive.  Over" 

2150. wav  "Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Delta  Six. 

Over" 
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Pile 

Message 

2151.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Echo 
Seven.  Over" 

2152.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Eoxtrot 
Eight.  Over" 

2153.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Golf  One. 
Over" 

2154.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Hotel  Two. 
Over" 

2155.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Alpha  Pour. 
Over" 

2156.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Bravo  Pive. 
Over" 

2157.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Charlie  Six. 
Over" 

2158.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Delta 
Seven.  Over" 

2159.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Echo 
Eight.  Over" 

2160.wav 

"Zulu  One,  this  is  control.  New  objective,  proceed  to  position  Eoxtrot 
One.  Over" 

Speaker  One  (Control) 

Target  Messages  (4  souree  trials) 

File _ Message _ 

4101. wav  "Yankee  One,  this  is  control. 

4102. wav  "Yankee  One,  this  is  control. 

4103. wav  "Yankee  One,  this  is  control. 

4104. wav  "Yankee  One,  this  is  control. 

4105. wav  "Yankee  One,  this  is  control. 

4106. wav  "Yankee  One,  this  is  control. 

4107. wav  "Yankee  One,  this  is  control. 

4108. wav  "Yankee  One,  this  is  control. 

4109. wav  "Yankee  One,  this  is  control. 

41 10.  wav  "Yankee  One,  this  is  control. 

4111  .wav  " Y ankee  One,  this  is  control. 

41 12. wav  "Yankee  One,  this  is  control. 

41 13. wav  "Yankee  One,  this  is  control. 

41 14. wav  "Yankee  One,  this  is  control. 

41 15. wav  "Yankee  One,  this  is  control. 


Proceed  to  position  Alpha  Five.  Over" 
Proceed  to  position  Bravo  Six.  Over" 
Proceed  to  position  Charlie  Seven.  Over" 
Proceed  to  position  Delta  Eight.  Over" 
Proceed  to  position  Echo  One.  Over" 
Proceed  to  position  Eoxtrot  Two.  Over" 
Proceed  to  position  Golf  Three.  Over" 
Proceed  to  position  Hotel  Pour.  Over" 
Proceed  to  position  Alpha  Six.  Over" 
Proceed  to  position  Bravo  Seven.  Over" 
Proceed  to  position  Charlie  Eight.  Over" 
Proceed  to  position  Delta  One.  Over" 
Proceed  to  position  Echo  Two.  Over" 
Proceed  to  position  Eoxtrot  Three.  Over" 
Proceed  to  position  Golf  Pour.  Over" 
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Speaker  One  (Control) 

Distracter  Messages  (4  source  trials) 


File _ 

41 16. wav 

4117. wav 

41 18. wav 

41 19. wav 

4120. wav 

4121. wav 

4122. wav 

4123. wav 

4124. wav 

4125. wav 

4126. wav 

4127. wav 

4128. wav 

4129. wav 

4130. wav 

4131. wav 

4132. wav 

4133. wav 

4134. wav 

4135. wav 


Message _ 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Alpha 
One.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Bravo 
Two.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Charlie 
Three.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Delta 
Four.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Echo 
Five.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Foxtrot 
Six.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Golf 
Seven.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Hotel 
Eight.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Alpha 
Two.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Bravo 
Three.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Charlie 
Eour.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Delta 
Eive.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Echo 
Six.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Eoxtrot 
Seven.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Golf 
Eight.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Hotel 
One.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Alpha 
Three.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Bravo 
Eour.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Charlie 
Eive.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Delta 
Six  Over" 
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File _ 

4136. wav 

4137. wav 

4138. wav 

4139. wav 

4140. wav 

4141. wav 

4142. wav 

4143. wav 

4144. wav 

4145. wav 

4146. wav 

4147. wav 

4148. wav 

4149. wav 

4150. wav 

4151. wav 

4152. wav 

4153. wav 

4154. wav 

4155. wav 

4156. wav 

4157. wav 


Message _ 

"Zulu  One,  this  is  eontrol.  Investigate  possible  hostile  at  position  Eeho 
Seven.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Foxtrot 
Eight.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Golf 
One.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Hotel 
Two.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Alpha 
Eour.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Bravo 
Eive.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Charlie 
Six.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Delta 
Seven.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Echo 
Eight.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Eoxtrot 
One.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Golf 
Two.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Hotel 
Three.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Alpha 
Eive.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Bravo 
Six.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Charlie 
Seven .  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Delta 
Eight.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Echo 
One.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Eoxtrot 
Two.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Golf 
Three.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Hotel 
Eour.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Alpha 
Six.  Over" 

"Zulu  One,  this  is  control.  Investigate  possible  hostile  at  position  Bravo 
Seven.  Over" 
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4158. wav 

4159. wav 

4160. wav 


"Zulu  One,  this  is  control. 
Eight.  Over" 

"Zulu  One,  this  is  control. 
One.  Over" 

"Zulu  One,  this  is  control. 
Two.  Over" 


Investigate  possible  hostile  at  position  Charlie 
Investigate  possible  hostile  at  position  Delta 
Investigate  possible  hostile  at  position  Echo 


Speaker  Two  (Zulu  One) 

Target  Messages  (2  source  trials) 


Eile _ 

2201. wav 

2202. wav 

2203. wav 

2204. wav 

2205. wav 

2206. wav 

2207. wav 

2208. wav 

2209. wav 

2210. wav 

221 1.  wav 

2212. wav 

2213. wav 

2214. wav 

2215. wav 

2216. wav 

2217. wav 

2218. wav 

2219. wav 

2220. wav 

2221. wav 

2222. wav 

2223. wav 

2224. wav 

2225. wav 

2226. wav 

2227. wav 

2228. wav 

2229. wav 

2230. wav 


Message 

"Yankee 

"Yankee 

"Yankee 

Over" 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

Over" 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

Over" 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 

"Yankee 


One,  this  is  Zulu  One.  Request  assistance  at  Alpha  One.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Bravo  Two.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Charlie  Three. 


One,  this  is  Zulu  One.  Request  assistance  at  Delta  Eour.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Echo  Eive.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Eoxtrot  Six.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Golf  Seven.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Hotel  Eight.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Alpha  Two.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Bravo  Three.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Charlie  Eour.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Delta  Eive.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Echo  Six.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Eoxtrot  Seven. 


One,  this  is  Zulu  One.  Request  assistance  at  Golf  Eight.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Hotel  One.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Alpha  Three.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Bravo  Eour.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Charlie  Eive.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Delta  Six.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Echo  Seven.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Eoxtrot  Eight. 


One,  this  is  Zulu  One. 
One,  this  is  Zulu  One. 
One,  this  is  Zulu  One. 
One,  this  is  Zulu  One. 
One,  this  is  Zulu  One. 
One,  this  is  Zulu  One. 
One,  this  is  Zulu  One. 
One,  this  is  Zulu  One. 
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Request  assistance 
Request  assistance 
Request  assistance 
Request  assistance 
Request  assistance 
Request  assistance 
Request  assistance 
Request  assistance 


at  Golf  One.  Over" 
at  Hotel  Two.  Over" 
at  Alpha  Eour.  Over" 
at  Bravo  Eive.  Over" 
at  Charlie  Six.  Over" 
at  Delta  Seven.  Over" 
at  Echo  Eight.  Over" 
at  Eoxtrot  One.  Over" 


Speaker  Two  (Zulu  One) 

Distracter  Messages  (2  source  trials) 

File _ Message _ 

2231. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Alpha 

One.  Over" 

2232. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Bravo 

Two.  Over" 

2233. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 

Charlie  Three.  Over" 

2234. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Delta 

Four.  Over" 

2235. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Echo 

Five.  Over" 

2236. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 

Foxtrot  Six.  Over" 

2237. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Golf 

Seven.  Over" 

2238. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Hotel 

Eight.  Over" 

2239. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Alpha 

Two.  Over" 

2240. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Bravo 

Three.  Over" 

2241. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 

Charlie  Eour.  Over" 

2242. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Delta 

Eive.  Over" 

2243. wav  "Control,  this  is  Zulu  One.  Obiective  complete.  We  are  moving  to  Echo 

Six.  Over" 

2244. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 

Eoxtrot  Seven.  Over" 

2245. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Golf 

Eight.  Over" 

2246. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Hotel 

One.  Over" 

2247. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Alpha 

Three.  Over" 

2248. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Bravo 

Eour.  Over" 

2249. wav  "Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 

Charlie  Eive.  Over" 

2250. wav  "Control,  this  is  Zulu  One.  Obiective  complete.  We  are  moving  to  Delta 

Six.  Over" 
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File _ 

225 1  .wav 

2252. wav 

2253. wav 

2254. wav 

2255. wav 

2256. wav 

2257. wav 

2258. wav 

2259. wav 

2260. wav 


Message _ 

"Control,  this  is  Zulu  One.  Objeetive  complete.  We  are  moving  to  Echo 
Seven.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 
Foxtrot  Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Golf 
One.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Hotel 
Two.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Alpha 
Four.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Bravo 
Five.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 
Charlie  Six.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Delta 
Seven.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to  Echo 
Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  complete.  We  are  moving  to 
Foxtrot  One.  Over" 


Speaker  Two  (Zulu  One) 

Target  Messages  (4  source  trials) 


File 

Message 

4201.wav 

"Yankee 

4202.wav 

"Yankee 

4203.wav 

"Yankee 

Over" 

4204.wav 

"Yankee 

4205.wav 

"Yankee 

4206.wav 

"Yankee 

4207.wav 

"Yankee 

4208.wav 

"Yankee 

4209.wav 

"Yankee 

4210.wav 

"Yankee 

421 1.  wav 

"Yankee 

Over" 

4212.wav 

"Yankee 

4213.wav 

"Yankee 

4214.wav 

"Yankee 

Over" 

One,  this  is  Zulu  One.  Request  assistance  at  Alpha  Five.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Bravo  Six.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Charlie  Seven. 


One,  this  is  Zulu  One.  Request  assistance  at  Delta  Eight.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Echo  One.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Foxtrot  Two.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Golf  Three.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Hotel  Four.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Alpha  Six.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Bravo  Seven.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Charlie  Eight. 


One,  this  is  Zulu  One.  Request  assistance  at  Delta  One.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Echo  Two.  Over" 
One,  this  is  Zulu  One.  Request  assistance  at  Foxtrot  Three. 
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File _ 

4215.wav 


Message _ 

"Yankee  One,  this  is  Zulu  One.  Request  assistanee  at  Golf  Four.  Over' 


Speaker  Two  (Zulu  One) 

Distracter  Messages  (4  souree  trials) 


File _ 

4216. wav 

4217. wav 

4218. wav 

4219. wav 

4220. wav 

4221. wav 

4222. wav 

4223. wav 

4224. wav 

4225. wav 

4226. wav 

4227. wav 

4228. wav 

4229. wav 

4230. wav 
423 1  .wav 

4232. wav 

4233. wav 


Message _ 

"Control,  this  is  Zulu  One.  Objeetive  Complete.  Moving  to  position 
Alpha  One.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Bravo  Two.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Charlie  Three.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Delta 
Four.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Echo 
Five.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Foxtrot  Six.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Golf 
Seven.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Hotel 
Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Alpha  Two.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Bravo  Three.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Charlie  Eour.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Delta 
Eive.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Echo 
Six.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Eoxtrot  Seven.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Golf 
Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Hotel 
One.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Alpha  Three.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Bravo  Eour.  Over" 
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File _ 

4234. wav 

4235. wav 

4236. wav 

4237. wav 

4238. wav 

4239. wav 

4240. wav 

4241. wav 

4242. wav 

4243. wav 

4244. wav 

4245. wav 

4246. wav 

4247. wav 

4248. wav 

4249. wav 

4250. wav 
425 1  .wav 

4252. wav 

4253. wav 

4254. wav 

4255. wav 


Message _ 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Charlie  Five.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Delta 
Six  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Echo 
Seven.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Foxtrot  Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Golf 
One.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Hotel 
Two.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Alpha  Eour.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Bravo  Eive.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Charlie  Six.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Delta 
Seven.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Echo 
Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Eoxtrot  One.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Golf 
Two.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Hotel 
Three.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Alpha  Eive.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Bravo  Six.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Charlie  Seven  .  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Delta 
Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Echo 
One.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Eoxtrot  Two.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Golf 
Three.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Hotel 
Eour.  Over" 
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File 


Message 


4256. wav 

4257. wav 

4258. wav 

4259. wav 

4260. wav 


"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Alpha  Six.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Bravo  Seven.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position 
Charlie  Eight.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Delta 
One.  Over" 

"Control,  this  is  Zulu  One.  Objective  Complete.  Moving  to  position  Echo 
Two.  Over" 


Speaker  Three  (Yankee  Two) 
Target  Messages  (4  source  trials) 
Eile _ Message _ 


4301.wav 

"Yankee 

4302.wav 

"Yankee 

4303.wav 

"Yankee 

4304.wav 

"Yankee 

4305.wav 

"Yankee 

4306.wav 

"Yankee 

4307.wav 

"Yankee 

4308.wav 

"Yankee 

4309.wav 

"Yankee 

4310.wav 

"Yankee 

4311  .wav 

"Yankee 

4312.wav 

"Yankee 

4313.wav 

"Yankee 

4314.wav 

"Yankee 

4315.wav 

"Yankee 

Speaker  Three  (Yank 

One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 
One,  this  is  Yankee 

ee  Two) 


Distracter  Messages  (4  source  trials) 


Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 

Two. 


Possible  hostile  at  Alpha  One.  Over" 
Possible  hostile  at  Bravo  Two.  Over" 
Possible  hostile  at  Charlie  Three.  Over" 
Possible  hostile  at  Delta  Pour.  Over" 
Possible  hostile  at  Echo  Pive.  Over" 
Possible  hostile  at  Poxtrot  Six.  Over" 
Possible  hostile  at  Golf  Seven.  Over" 
Possible  hostile  at  Hotel  Eight.  Over" 
Possible  hostile  at  Alpha  Two.  Over" 
Possible  hostile  at  Bravo  Three.  Over" 
Possible  hostile  at  Charlie  Pour.  Over" 
Possible  hostile  at  Delta  Pive.  Over" 
Possible  hostile  at  Echo  Six.  Over" 
Possible  hostile  at  Poxtrot  Seven.  Over" 
Possible  hostile  at  Golf  Eight.  Over" 


Pile _ 

4316. wav 

4317. wav 

4318. wav 


Message _ 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Alpha 
One.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Bravo 
Two.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Charlie 
Three.  Over" 
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File _ 

4319. wav 

4320. wav 

4321. wav 

4322. wav 

4323. wav 

4324. wav 

4325. wav 

4326. wav 

4327. wav 

4328. wav 

4329. wav 

4330. wav 

4331. wav 

4332. wav 

4333. wav 

4334. wav 

4335. wav 

4336. wav 

4337. wav 

4338. wav 

4339. wav 

4340. wav 


Message _ 

"Yankee  Three,  this  is  Yankee  Two.  I  am  elosing  in  on  the  target  at  Delta 
Four.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  elosing  in  on  the  target  at  Echo 
Five.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Foxtrot  Six.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Golf 
Seven.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Hotel 
Eight.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Alpha 
Two.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Bravo 
Three.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Charlie  Eour.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Delta 
Eive.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Echo 
Six.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Eoxtrot  Seven.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Golf 
Eight.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Hotel 
One.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Alpha 
Three.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Bravo 
Eour.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Charlie  Eive.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Delta 
Six  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Echo 
Seven.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Eoxtrot  Eight.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Golf 
One.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Hotel 
Two.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Alpha 
Eour.  Over" 
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4341. wav 

File _ 

4342. wav 

4343. wav 

4344. wav 

4345. wav 

4346. wav 

4347. wav 

4348. wav 

4349. wav 

4350. wav 

4351. wav 

4352. wav 

4353. wav 

4354. wav 

4355. wav 

4356. wav 

4357. wav 

4358. wav 

4359. wav 

4360. wav 


"Yankee  Three,  this  is  Yankee  Two.  I  am  elosing  in  on  the  target  at  Bravo 
Five.  Over" 

Message _ 

"Yankee  Three,  this  is  Yankee  Two.  I  am  elosing  in  on  the  target  at 
Charlie  Six.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  elosing  in  on  the  target  at  Delta 
Seven.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Echo 
Eight.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Eoxtrot  One.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Golf 
Two.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Hotel 
Three.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Alpha 
Eive.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Bravo 
Six.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Charlie  Seven  .  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Delta 
Eight.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Echo 
One.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Eoxtrot  Two.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Golf 
Three.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Hotel 
Eour.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Alpha 
Six.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Bravo 
Seven.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at 
Charlie  Eight.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Delta 
One.  Over" 

"Yankee  Three,  this  is  Yankee  Two.  I  am  closing  in  on  the  target  at  Echo 
Two.  Over" 
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Speaker  Four  (Yankee  Three) 
Target  Messages  (4  source  trials) 


File _ 

4401. wav 

4402. wav 

4403. wav 

4404. wav 

4405. wav 

4406. wav 

4407. wav 

4408. wav 

4409. wav 

4410. wav 

441 1.  wav 

4412. wav 

4413. wav 

4414. wav 

4415. wav 


Message _ 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Alpha  Five. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Bravo  Six. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Charlie  Seven. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Delta  Eight. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Echo  One.  Over" 
"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Eoxtrot  Two. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Golf  Three. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Hotel  Eour. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Alpha  Six. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Bravo  Seven. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Charlie  Eight. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Delta  One. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Echo  Two. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Eoxtrot  Three. 
Over" 

"Yankee  One,  this  is  Yankee  Three.  Attacking  target  at  Golf  Eour.  Over" 


Speaker  Eour  (Yankee  Three) 

Distracter  Messages  (4  source  trials) 

Eile _ Message _ 

4416. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Alpha  One.  Over" 

4417. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Bravo  Two.  Over" 
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File _ Message _ 

4418. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Charlie  Three.  Over" 

4419. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Delta  Four.  Over" 

4420. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Echo  Five.  Over" 

4421. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Foxtrot  Six.  Over" 

4422. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at  Golf 

Seven.  Over" 

4423. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Hotel  Eight.  Over" 

4424. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Alpha  Two.  Over" 

4425. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Bravo  Three.  Over" 

4426. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Charlie  Eour.  Over" 

4427. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Delta  Eive.  Over" 

4428. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Echo  Six.  Over" 

4429. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Eoxtrot  Seven.  Over" 

4430. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at  Golf 

Eight.  Over" 

4431. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Hotel  One.  Over" 

4432. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Alpha  Three.  Over" 

4433. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Bravo  Eour.  Over" 

4434. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Charlie  Eive.  Over" 

4435. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Delta  Six  Over" 

4436. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Echo  Seven.  Over" 

4437. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Eoxtrot  Eight.  Over" 

4438. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at  Golf 

One.  Over" 

4439. wav  "Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 

Hotel  Two.  Over" 
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File _ 

4440. wav 

4441. wav 

4442. wav 

4443. wav 

4444. wav 

4445. wav 

4446. wav 

4447. wav 

4448. wav 

4449. wav 

4450. wav 
445 1  .wav 

4452. wav 

4453. wav 

4454. wav 

4455. wav 

4456. wav 

4457. wav 

4458. wav 

4459. wav 

4460. wav 


Message _ 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Alpha  Four.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Bravo  Five.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Charlie  Six.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Delta  Seven.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Echo  Eight.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Eoxtrot  One.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at  Golf 
Two.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Hotel  Three.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Alpha  Eive.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Bravo  Six.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Charlie  Seven  .  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Delta  Eight.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Echo  One.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Eoxtrot  Two.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at  Golf 
Three.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Hotel  Eour.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Alpha  Six.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Bravo  Seven.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Charlie  Eight.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Delta  One.  Over" 

"Yankee  Two,  this  is  Yankee  Three.  I  have  sighted  another  hostile  at 
Echo  Two.  Over" 
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APPENDIX  B.  PILOT  STUDY  SCRIPT  GENERATION 


The  following  code  was  used  to  construct  experimental  trials. 


import  java. util.*; 

public  class  ScriptMakerl { 

public  static  void  main (String  args[]){ 

//target  messages  for  2  and  4  source  experiments, 
//ex.  v21  =  2  sources,  voice  1 


Array List  v21 Target 
ArrayList  v22Target 
ArrayList  v41Target 
ArrayList  v42Target 
ArrayList  v43Target 
ArrayList  v4 4 Target 


=  new  ArrayList  0; 
=  new  ArrayList  0; 
=  new  ArrayList  0; 
=  new  ArrayList  0; 
=  new  ArrayList  0; 
=  new  ArrayList  0; 


//distractor  messages  for  2  and  4  source  experiments 
ArrayList  v21Distractors  =  new  ArrayList (); 

ArrayList  v22Distractor s  =  new  ArrayList (); 

ArrayList  v4 IDistractors  =  new  ArrayList (); 

ArrayList  v42Distractor s  =  new  ArrayList (); 

ArrayList  v43Distractors  =  new  ArrayList (); 

ArrayList  v44Distractors  =  new  ArrayList (); 


ArrayList  twoVoice  =  new  ArrayList (); 
ArrayList  fourVoice  =  new  ArrayList (); 
Integer  target  =  new  Integer (0); 
int  random; 


//populates  arrays  with  message  file  identifiers  for  2  source  experiment 
for  (int  i=2101;  i  <=  2130;  i  +  +  )  { 
v2 1 Target . add (new  Integer ( i ) ) ; 

} 


for  (int  i=2201;  i  <=  2230;  i++) { 
v2 2 Target . add (new  Integer ( i )  )  ; 

} 


for  (int  i=2131;  i  <=  2160;  i++)  { 

v2 IDistractors . add (new  Integer (i) ) ; 

} 


for  (int  i=2231;  i  <=  2260;  i++) { 

v22Distractors . add (new  Integer (i) ) ; 

} 


//populates  arrays  with  message  file  identifiers  for  4  source  experiment 

for  (int  i=4101;  i  <=  4115;  i++) { 
v4 1 Target . add (new  Integer ( i )  )  ; 

} 

for  (int  i=4201;  i  <=  4215;  i  +  +  )  { 
v4 2 Target . add (new  Integer ( i ) ) ; 

} 

for  (int  i=4301;  i  <=  4315;  i++) { 
v43Target . add (new  Integer (i)  )  ; 

} 

for  (int  i=4401;  i  <=  4415;  i  +  +  )  { 
v4 4 Target . add (new  Integer (i) ) ; 

} 
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for  (int  i=4116;  i  <=  4160;  i++) { 

v41Distractors . add (new  Integer (i) ) ; 

} 

for  (int  i=4216;  i  <=  4260;  i  +  +  )  { 

v42Distractors . add (new  Integer (i) ) ; 

} 

for  (int  i=4316;  i  <=  4360;  i  +  +  )  { 

v43Distractors . add (new  Integer (i) ) ; 

} 


for  (int  i=4416;  i  <=  4460;  i++) { 

v44Distractors . add (new  Integer (i) ) ; 

} 


//Experiment  with  two  sources 
for  (int  i  =0;  i<30;  i++) { 

twoVoice . add (new  Integer (1)); 
twoVoice . add (new  Integer (2)); 

} 

while (twoVoice . size  0 >0)  { 

random  =  ( int ) (twoVoice . size () *Math . random ()) ; 
target  =  (Integer) twoVoice . remove (random) ; 
if  (target . intValue ( )  ==  1) { 

random  =  ( int ) (v21Target . size () *Math . random ()) ; 
target  =  ( Integer) v21 Target . remove (random) ; 

System. out .print (target . intValue ()+":") ; 
random  =  ( int ) (v22Distractors . size () *Math . random ()) ; 
target  =  ( Integer) v22Distr actors . remove (random) ; 
System . out . print In (target . intValue ( ) ) ; 

} 

else  { 

random  =  ( int ) (v22Target . size () *Math . random ()) ; 
target  =  ( Integer ) v22Target . remove (random) ; 

System . out .print (target . intValue ()+":")  ; 
random  =  ( int ) (v21Distr actors . size ( ) *Math . random ( ) ) ; 
target  =  ( Integer) v21Distr actors . remove (random) ; 
System . out . print In (target . intValue ( ) ) ; 

} 


//Experiment  with  four  sources 
for  (int  i  =0;  i<15;  i++) { 

f ourVoice . add (new  Integer ( 1 ) )  ; 
f ourVoice . add (new  Integer (2)); 
f ourVoice . add (new  Integer (3)); 
f ourVoice . add (new  Integer ( 4 ) )  ; 


while ( f ourVoice . size  0 >0 )  { 

random  =  ( int )( f ourVoice . size () *Math . random ()) ; 
target  =  (Integer) f ourVoice . remove (random) ; 
switch (target . intValue ( ) ) { 
case  1: 

random  =  ( int )  (v4 ITarget . size () *Math . random ()) ; 
target  =  (Integer) v41Target . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  (int) (v42Distractors . size () *Math . random () ) 

target  =  (Integer) v42Distractors . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  (int) (v4 3Distractors . size () *Math . random () ) 

target  =  ( Integer) v4  3Distr actors . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  (int) (v4 4Distractors . size () *Math . random () ) 

target  =  (Integer) v44Distr actors . remove (random) ; 

System . out . print In (target . intValue ( ) ) ; 

break; 


case  2 : 


78 


random  =  ( int ) (v42Target . size () *Math . random ()) ; 
target  =  (Integer) v42Target . remove (random) ; 

System . out .print (target . intValue ()+":")  ; 

random  =  (int) (v4 IDistractors . size () *Math . random () ) 

target  =  ( Integer) v4 IDistr actors . remove (random) ; 

System. out .print (target . intValue ()+":")  ; 

random  =  (int) (v4 SDistractors . size () *Math . random () ) 

target  =  (Integer) v43Distractors . remove (random) ; 

System . out .print (target . intValue ()+":")  ; 

random  =  (int) (v4 4Distractors . size () *Math . random () ) 

target  =  (Integer) v44Distr actors . remove (random) ; 

System . out . print In (target . intValue ( ) )  ; 

break; 

case  3: 

random  =  ( int ) (v4 3Target . size () *Math . random ()) ; 
target  =  (Integer) v43Target . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  (int) (v42Distractors . size () *Math . random () ) 

target  =  (Integer) v42Distractors . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  (int) (v4 IDistractors . size () *Math . random () ) 

target  =  ( Integer) v4 IDistr actors . remove (random) ; 

System. out .print (target . intValue ()+":") ; 

random  =  (int) (v4 4Distractors . size () *Math . random () ) 

target  =  (Integer) v44Distr actors . remove (random) ; 

System . out . print In (target . intValue ( ) ) ; 

break; 

default : 

random  =  ( int )  (v4 4Target . size () *Math . random ())  ; 
target  =  (Integer) v44Target . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  (int) (v42Distractors . size () *Math . random () ) 

target  =  (Integer) v42Distractors . remove (random) ; 

System. out .print (target . intValue ()+":") ; 

random  =  (int) (v4 3Distractors . size () *Math . random () ) 

target  =  ( Integer) v4  3Distr actors . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  (int) (v4 IDistractors . size () *Math . random () ) 

target  =  (Integer) v41Distractors . remove (random) ; 

System . out . print In (target . intValue ( ) ) ; 

break; 
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APPENDIX  C.  PILOT  STUDY  SCRIPT 


This  appendix  contains  the  ascii  text  output  from  the  JAVA  generator  which  has  been 
reformatted  in  Microsoft  Excel.  Numbers  refer  to  the  wave  file  names  found  in 
Appendix  A. 


Part  One  (Two  Voices) 

Trial 

Target 

Distracter 

1 

2121 

2243 

2 

2103 

2231 

3 

2222 

2134 

4 

2228 

2156 

5 

2209 

2146 

6 

2201 

2152 

7 

2208 

2131 

8 

2216 

2135 

9 

2116 

2257 

10 

2120 

2244 

11 

2223 

2159 

12 

2217 

2144 

13 

2126 

2245 

14 

2211 

2147 

15 

2124 

2232 

16 

2109 

2250 

17 

2226 

2154 

18 

2104 

2255 

19 

2224 

2157 

20 

2214 

2155 

21 

2206 

2145 

22 

2225 

2136 

23 

2207 

2142 

24 

2227 

2153 

25 

2128 

2251 

26 

2204 

2137 

27 

2112 

2238 

28 

2108 

2239 

29 

2115 

2252 

30 

2202 

2150 

31 

2210 

2132 

32 

2106 

2240 

33 

2118 

2259 

34 

2219 

2158 

35 

2130 

2253 

36 

2221 

2133 

37 

2113 

2246 

81 


38 

2123 

2256 

39 

2230 

2149 

40 

2220 

2151 

41 

2125 

2234 

42 

2129 

2247 

43 

2213 

2160 

44 

2111 

2242 

45 

2107 

2235 

46 

2218 

2143 

47 

2212 

2138 

48 

2119 

2237 

49 

2105 

2248 

50 

2110 

2236 

51 

2102 

2233 

52 

2203 

2139 

53 

2215 

2140 

54 

2122 

2260 

55 

2101 

2241 

56 

2127 

2249 

57 

2229 

2141 

58 

2205 

2148 

59 

2114 

2254 

60 

2117 

2258 
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Part  Two  (Four  Voices) 


Trial 

Target 

Distracter  1 

Distracter  2 

Distracter  3 

61 

4108 

4217 

4358 

4416 

62 

4209 

4119 

4340 

4421 

63 

4204 

4157 

4357 

4451 

64 

4103 

4253 

4338 

4457 

65 

4110 

4246 

4354 

4442 

66 

4406 

4216 

4326 

4127 

67 

4407 

4228 

4346 

4137 

68 

4414 

4218 

4350 

4139 

69 

4111 

4260 

4334 

4435 

70 

4213 

4131 

4352 

4431 

71 

4112 

4257 

4333 

4439 

72 

4403 

4241 

4329 

4133 

73 

4206 

4123 

4339 

4459 

74 

4404 

4256 

4356 

4156 

75 

4411 

4238 

4332 

4145 

76 

4211 

4129 

4316 

4438 

77 

4203 

4124 

4323 

4452 

78 

4310 

4233 

4159 

4427 

79 

4212 

4121 

4327 

4440 

80 

4415 

4254 

4331 

4130 

81 

4115 

4255 

4336 

4429 

82 

4311 

4220 

4132 

4454 

83 

4113 

4224 

4353 

4424 

84 

4408 

4243 

4348 

4149 

85 

4214 

4116 

4335 

4437 

86 

4313 

4236 

4150 

4422 

87 

4215 

4154 

4317 

4453 

88 

4305 

4230 

4152 

4423 

89 

4410 

4242 

4351 

4142 

90 

4413 

4252 

4347 

4147 

91 

4109 

4232 

4344 

4444 

92 

4307 

4222 

4120 

4436 

93 

4114 

4227 

4355 

4447 

94 

4210 

4146 

4330 

4419 

95 

4207 

4125 

4359 

4443 

96 

4202 

4153 

4337 

4450 

97 

4104 

4249 

4325 

4455 

98 

4312 

4219 

4148 

4418 

99 

4107 

4251 

4342 

4433 

100 

4308 

4244 

4155 

4430 

101 

4304 

4258 

4118 

4458 

102 

4409 

4237 

4349 

4140 

103 

4101 

4229 

4321 

4428 

104 

4106 

4259 

4319 

4441 

105 

4315 

4248 

4138 

4432 

83 

MM 

4134 

4322 

4420 

4231 

4128 

4426 

4314 

4226 

4141 

4449 

4235 

4143 

4434 

110 

4136 

4324 

4446 

111 

4223 

4318 

4135 

112 

4158 

4343 

4445 

113 

4221 

4126 

4417 

114 

4250 

4341 

4448 

115 

4401 

4247 

4360 

4144 

116 

4239 

4320 

4460 

117 

4412 

4245 

4328 

4160 

118 

4303 

4234 

4122 

4456 

119 

4240 

4117 

4425 

4402 

4225 

4345 

4151 
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APPENDIX  D.  PILOT  STUDY  INSTRUCTIONS 


This  experiment  will  attempt  to  eapture  the  important  elements  of  a  task  that 
requires  simultaneous  attention  to  multiple  communieations  channels.  Participants  are 
placed  in  the  role  of  a  unit  leader  in  a  generic  military  environment  (Yankee  One).  They 
are  then  asked  to  listen  to  messages  from  two  subordinates  (Yankee  TwoAf ankee  Three), 
a  peer  (Zulu  One),  and  a  command  entity  (Control). 

For  each  trial,  participants  are  asked  to  listen  to  either  two  or  four  overlapping 
messages  over  headphones.  They  respond  to  the  message  that  is  addressed  to  them  by 
making  selections  from  drop-down  lists  in  a  data  entry  form.  The  purpose  of  the  study  is 
to  determine  whether  a  spatial  auditory  display  increases  message  intelligibility 
(measured  by  response  accuracy).  Without  the  display,  messages  sound  as  if  they  are 
being  delivered  over  normal  stereo  headphones.  With  spatial  audio,  the  sounds  should 
appear  to  originate  from  two  or  four  separate  locations  around  the  listener. 

Instructions;  You  will  listen  to  120  sets  of  overlapping  messages.  Each  set  will 
last  approximately  five  seconds.  Listen  for  your  call-  sign  and  attempt  to  focus  on  the 
corresponding  message.  You  will  be  asked  to  respond  to  the  message  by  identifying  two 
elements. 

1)  Who  was  the  Speaker  that  addressed  you? 

Voice  One  -  "Control" 

Voice  Two  -  "Zulu  One" 

Voice  Three  -  "Yankee  Two" 

Voice  Four  -  "Yankee  Three" 

Note:  During  the  first  60  trials  you  will  only  hear  messages  from  Control  and 
Zulu  One. 

2)  Which  Coordinate  Position  was  referenced  in  the  target  message? 

a)  Y-Axis;  alphabetical  component 

b)  X-Axis;  numeric  component 
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APPENDIX  E.  TIME  SERIES  PLOTS 


2  voices,  non-spatialized,  aggregate 


2  voice,  spatialized,  aggregate 
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2  voices,  non-spatialized,  alpha 


2  voices,  spatialized,  alpha 
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4  voices,  spatialized,  alpha 


4  voices,  non-spatialized,  alpha 
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2  voices,  spatialized,  number 


2  voices,  non-spatialized,  number 
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4  voices,  spatialized,  number 


4  voices,  non-spatialized,  number 
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2  voices,  spatialized,  speaker 


2  voices,  non-spatialized,  speaker 
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4  voices,  spatialized,  speaker 


4  voices,  non-spatialized,  speaker 
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APPENDIX  F.  FINAL  EXPERIMENT  SCRIPT  GENERATOR 


import  java. util.*; 
public  class  ScriptMakerl { 

public  static  void  main (String  args[]){ 

//target  messages  for  3  and  4  source  experiments 

ArrayList  v41Target  =  new  ArrayListO; 

ArrayList  v42Target  =  new  ArrayListO; 

ArrayList  v43Target  =  new  ArrayListO; 

ArrayList  v44Target  =  new  ArrayListO; 

//distractor  messages  for  3  and  4  source  experiments 

ArrayList  v41Distractors  =  new  ArrayListO; 

ArrayList  v42Distractors  =  new  ArrayListO; 

ArrayList  v43Distractors  =  new  ArrayListO; 

ArrayList  v44Distractors  =  new  ArrayListO; 

ArrayList  threeVoice  =  new  ArrayListO; 

ArrayList  fourVoice  =  new  ArrayListO; 

Integer  target  =  new  Integer  (0); 

int  random; 

int  index; 

ArrayList  treatmentOne  =  new  ArrayListO; 

ArrayList  treatmentTwo  =  new  ArrayListO; 

ArrayList  temp  =  new  ArrayListO; 

ArrayList  bin  =  new  ArrayListO; 

//fill  two  arrays  with  sequences  of  0  and  1  with  runs  no  larger  than  6 

for  (int  j  =  0;  j<10  ;j++){ 

for  (int  k=0;  k;<3;  k  +  +  )  { 

bin.add(new  Integer  (0)); 
bin.add(new  Integer  (1)); 

} 

while  (bin. size  0 >0)  { 

random  =  ( int )  (bin.sizeO  *Math .  random  ()  )  ; 
target  =  ( Integer) bin . remove (random) ; 
treatmentOne . add (target)  ; 

} 

} 

for  (int  j  =  0;  j<10  ;j++){ 

for  (int  k=0; k<3; k++) { 

bin.add(new  Integer (0)); 
bin.add(new  Integer (1)); 

} 

while  (bin. size  0 >0)  { 

random  =  ( int )  (bin . size () *Math . random ()) ; 
target  =  ( Integer) bin . remove (random) ; 
treatmentTwo . add (target) ; 


System . out . print In (treatmentOne . size () ) ; 
System . out . print In (treatmentTwo . size () ) ; 


//populate  arrays  with  message  file  identifiers 
for  (int  i=4101;  i  <=  4115;  i++)  { 
v41Target . add (new  Integer (i)); 

} 

for  (int  i=4201;  i  <=  4215;  i++) { 
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v42Target . add (new  Integer  (i)); 


} 

for  (int  i=4301;  i  <=  4315;  i++) { 
v43Target . add (new  Integer  (i) ) ; 

} 


for  (int  i=4401;  i  <=  4415;  i++) { 
v44Target . add (new  Integer  (i)); 

} 


for  (int  i=4116;  i  <=  4160;  i++) { 

v41Distractors . add (new  Integer (i) ) ; 

} 


for  (int  i=4216;  i  <=  4260;  i++)  { 

v42Distractors . add (new  Integer (i)  )  ; 

} 


for  (int  i=4316;  i  <=  4360;  i++)  { 

v43Distractors . add (new  Integer (i) ) ; 

} 


for  (int  i=4416;  i  <=  4460;  i++) { 

v44Distractors . add (new  Integer (i) ) ; 

} 


//Experiment  with  three  sources 
for  (int  i  =0;  i<20;  i++) { 

threeVoice . add (new  Integer (1) ) ; 
threeVoice . add (new  Integer (2) ) ; 
threeVoice . add (new  Integer (3)); 

} 

System . out . print In ( "Three  Voice  Trials") ; 
while (threeVoice . size  0 >0 )  { 

index  =  60  -  threeVoice . size () ; 

random  =  ( int ) (threeVoice . size () *Math . random ()) ; 
target  =  ( Integer) threeVoice . remove (random) ; 
switch (target . int Value ( ) ) { 
case  1 : 

System . out . print ( index  +  1  +  ":"); 

System . out .print ( ( ( Integer) treatment One . remove ( 0 ) ) . int Value ( )  + 

random  =  ( int ) (v4 ITarget . size () *Math . random ()) ; 
target  =  (Integer) v41Target .get (random) ; 

System . out .print (target . int Value ()+":")  ; 

random  =  ( int )  (v4 3Distr actors . size ( ) *Math . random ( ) ) ; 

target  =  ( Integer ) v4 3Distractors . get (random) ; 

System. out .print (target . intValue ()+":")  ; 

random  =  ( int ) (v4 4Distractors . size () *Math . random ()) ; 

target  =  ( Integer) v4  4Distr actors . get (random) ; 

System . out . print In (target . intValue ( ) ) ; 
break; 

case  2 : 

System . out . print ( index  +  1  +  ":"); 

System . out .print ( ( ( Integer) treatment One . remove ( 0 ) ) . intValue ( )  + 

random  =  ( int ) (v4 3Target . size () *Math . random ()) ; 
target  =  (Integer) v4 3 Tar get . get (random) ; 

System . out .print (target . intValue ()+":")  ; 

random  =  ( int ) (v4 IDistractors . size () *Math . random ()) ; 

target  =  ( Integer) v4 IDistr actors . get (random) ; 

System . out .print (target . intValue ()+":")  ; 

random  =  ( int ) (v4 4Distractors . size () *Math . random ()) ; 

target  =  ( Integer) v4  4Distr actors . get (random) ; 

System . out . print In (target . intValue ( ) ) ; 
break; 

default : 

System . out . print ( index  +  1  +  ":"); 
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System . out .print ( ( ( Integer) treatment One . remove ( 0 ) ) . int Value ( )  + 

random  =  ( int ) (v4 4Target . size () *Math . random ()) ; 
target  =  ( Integer) v4  4 Target . get (random) ; 

System. out .print (target . int Value ()+":")  ; 

random  =  ( int )  (v4 SDistr actors . size ( ) *Math . random ( ) ) ; 

target  =  ( Integer ) v4 SDistractors . get (random) ; 

System . out .print (target . int Value ()+":")  ; 

random  =  ( int )  (v4 IDistractors . size () *Math . random ()) ; 

target  =  ( Integer) v4 IDistr actors . get (random) ; 

System . out . print In (target . int Value ( ) )  ; 
break; 


//Experiment  with  four  sources 
for  (int  i  =0;  i<15;  i++)  { 

f ourVoice . add (new  Integer ( 1 ) ) ; 
fourVoice . add (new  Integer (2) )  ; 
f ourVoice . add (new  Integer (3)); 
fourVoice . add (new  Integer (4)); 


} 

System . out . print In ( "Four  Voice  Trials") ; 
while ( fourVoice . size  0 >0 )  { 

index  =  60  -  fourVoice . size () ; 

random  =  ( int )( fourVoice . size () *Math . random ()) ; 
target  =  (Integer) fourVoice . remove (random) ; 
switch (target . int Value ( ) ) { 
case  1 : 

System . out . print ( index  +  1  +  ":"); 

System . out .print ( ( ( Integer) treatment Two . remove ( 0 ) ) . int Value ( )  + 
"  :  "  )  ; 

random  =  ( int ) (v4 ITarget . size () *Math . random ()) ; 
target  =  (Integer) v41Target . remove (random) ; 

System . out .print (target . int Value ()+":") ; 

random  =  ( int )  (v42Distractors . size () *Math . random ()) ; 

target  =  (Integer) v42Distractors . remove (random) ; 

System . out .print (target . int Value ()+":") ; 

random  =  ( int )  (v4 SDistractors . size ( ) *Math . random ( ) ) ; 

target  =  (Integer) v43Distractors . remove (random) ; 

System. out .print (target . int Value ()+":") ; 

random  =  ( int ) (v4 4Distractors . size () *Math . random ()) ; 

target  =  (Integer) v44Distr actors . remove (random) ; 

System . out . print In (target . int Value ( ) ) ; 
break; 

case  2 : 

System . out . print ( index  +  1  +  ":"); 

System . out .print ( ( ( Integer) treatment Two . remove ( 0 ) ) . int Value ( )  + 

random  =  ( int ) (v42Target . size () *Math . random ()) ; 
target  =  (Integer) v42Target . remove (random) ; 

System. out .print (target . int Value ()+":")  ; 

random  =  ( int ) (v4 IDistractors . size () *Math . random ()) ; 

target  =  (Integer) v4 IDistr actors . remove (random) ; 

System . out .print (target . int Value ()+":")  ; 

random  =  ( int ) (v4 SDistractors . size () *Math . random ()) ; 

target  =  (Integer) v43Distractors . remove (random) ; 

System. out .print (target . int Value ()+":") ; 

random  =  ( int ) (v4 4Distractors . size () *Math . random ()) ; 

target  =  (Integer) v44Distr actors . remove (random) ; 

System . out . print In (target . int Value ( ) ) ; 
break; 

case  3: 

System . out . print ( index  +  1  +  ":"); 

System. out .print ( ( (Integer) treatment Two . remove (0) ) . int Value ( )  + 

random  =  ( int )  (v4 STarget . size () *Math . random ()) ; 
target  =  (Integer) v43Target . remove (random) ; 
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System. out .print (target . intValue ()+":")  ; 

random  =  ( int ) (v42Distractors . size () *Math . random ()) ; 

target  =  (Integer) v42Distractors . remove (random) ; 

System . out .print (target . intValue ()+":")  ; 

random  =  ( int )  (v4 IDistractors . size () *Math . random ()) ; 

target  =  (Integer) v41Distr actors . remove (random) ; 

System . out .print (target . intValue ()+":")  ; 

random  =  ( int ) (v4 4Distractors . size () *Math . random ()) ; 

target  =  (Integer) v44Distr actors . remove (random) ; 

System. out .print In (target . intValue ( ) ) ; 
break; 

default : 

System. out .print (index  +  1  +  ":"); 

System. out .print ( ( (Integer) treatment Two . remove (0) ) . intValue ( )  + 

random  =  (int ) (v4 4Target . size () *Math . random ()) ; 
target  =  (Integer) v44Target . remove (random) ; 

System. out .print (target . intValue ()+":") ; 

random  =  ( int ) (v42Distractors . size () *Math . random ()) ; 

target  =  (Integer) v42Distractors . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  ( int )  (v4 SDistractors . size () *Math . random ()) ; 

target  =  (Integer) v43Distr actors . remove (random) ; 

System . out .print (target . intValue ()+":") ; 

random  =  ( int ) (v4 IDistractors . size () *Math . random ()) ; 

target  =  (Integer) v41Distractors . remove (random) ; 

System . out . print In (target . intValue ( ) ) ; 
break; 
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APPENDIX  G.  FINAL  EXPERIMENT  SCRIPT 


3  Voice  Trials 

Treatment 

1 

1 

2 

1 

3 

1 

D1 

4333 

4346 

4134 

4159 

4158 

4320 

4336 
4358 

4146 

4337 
4116 
4336 
4352 
4152 
4137 
4349 
4157 
4124 

4147 

4329 
4335 
4327 
4348 

4131 
4320 
4322 

4132 

4330 
4144 
4335 
4355 
4339 
4342 
4144 
4126 


D2 

4144 

4438 

4447 

4451 

4452 
4441 
4146 
4151 

4445 

4421 

4446 
4153 
4149 
4443 

4447 
4123 

4432 
4418 
4440 
4443 
4120 

4433 
4128 

4440 

4422 
4437 

4441 

4429 
4416 
4446 
4144 
4160 
4452 
4426 

4430 


99 


36 

1 

4415 

4335 

4143 

37 

0 

4308 

4124 

4417 

38 

0 

4405 

4342 

4123 

39 

0 

4108 

4342 

4439 

40 

1 

4407 

4337 

4149 

41 

1 

4109 

4334 

4416 

42 

1 

4312 

4139 

4416 

43 

1 

4308 

4128 

4449 

44 

1 

4112 

4331 

4439 

45 

1 

4410 

4322 

4143 

46 

0 

4409 

4316 

4158 

47 

0 

4401 

4359 

4129 

48 

0 

4102 

4348 

4419 

49 

0 

4403 

4340 

4156 

50 

1 

4303 

4131 

4457 

51 

0 

4112 

4341 

4430 

52 

1 

4410 

4345 

4131 

53 

0 

4111 

4333 

4457 

54 

1 

4112 

4324 

4418 

55 

1 

4115 

4318 

4438 

56 

0 

4103 

4327 

4436 

57 

0 

4304 

4147 

4428 

58 

1 

4403 

4333 

4123 

59 

0 

4102 

4321 

4448 

60 

1 

4411 

4320 

4122 

100 


13 

0 

4407 

4243 

4345 

4116 

14 

0 

4210 

4118 

4360 

4455 

15 

1 

4111 

4248 

4350 

4436 

16 

1 

4405 

4233 

4355 

4139 

17 

1 

4408 

4221 

4332 

4137 

18 

0 

4306 

4218 

4149 

4453 

19 

1 

4310 

4219 

4153 

4446 

20 

0 

4313 

4260 

4154 

4441 

21 

0 

4312 

4246 

4123 

4457 

22 

0 

4201 

4132 

4331 

4420 

23 

1 

4406 

4227 

4352 

4130 

24 

1 

4114 

4228 

4339 

4456 

25 

1 

4113 

4256 

4359 

4434 

26 

0 

4214 

4131 

4318 

4440 

27 

0 

4215 

4134 

4338 

4419 

28 

1 

4304 

4249 

4157 

4423 

29 

1 

4108 

4259 

4340 

4426 

30 

0 

4411 

4236 

4348 

4159 

31 

1 

4104 

4232 

4342 

4430 

32 

0 

4204 

4155 

4358 

4417 

33 

0 

4209 

4151 

4329 

4432 

34 

0 

4105 

4258 

4347 

4431 

35 

1 

4410 

4237 

4341 

4145 

36 

1 

4308 

4229 

4147 

4418 

37 

0 

4314 

4250 

4135 

4451 

38 

1 

4307 

4230 

4144 

4416 

39 

1 

4106 

4222 

4346 

4437 

40 

0 

4208 

4129 

4335 

4452 

41 

0 

4401 

4231 

4319 

4138 

42 

1 

4403 

4242 

4353 

4158 

43 

1 

4412 

4244 

4356 

4156 

44 

0 

4110 

4226 

4325 

4429 

45 

0 

4207 

4127 

4316 

4460 

46 

0 

4107 

4252 

4334 

4439 

47 

1 

4404 

4216 

4349 

4142 

48 

1 

4415 

4223 

4327 

4148 

49 

0 

4112 

4241 

4317 

4443 

50 

1 

4309 

4217 

4140 

4449 

51 

1 

4311 

4253 

4152 

4445 
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52 

1 

4211 

4136 

4321 

4438 

53 

0 

4109 

4224 

4337 

4425 

54 

0 

4409 

4239 

4333 

4120 

55 

1 

4402 

4257 

4324 

4128 

56 

1 

4203 

4141 

4344 

4424 

57 

1 

4205 

4121 

4336 

4427 

58 

0 

4303 

4254 

4124 

4435 

59 

0 

4301 

4255 

4117 

4421 

60 

0 

4315 

4245 

4143 

4448 
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APPENDIX  H.  FINAL  EXPERIMENT  PROCEDURE  CHECKLIST 


1)  Ask  participant  to  be  seated  and  complete  consent  forms. 

2)  Ask  participants  to  place  headphones  over  ears  with  red  tape  on  the  right. 

3)  Explain  the  structure  of  a  message  (addressee  call  sign,  speaker  call  sign,  two-part 
coordinate). 

-  Show  the  participant  the  list  of  call  signs,  coordinate  system  illustration,  and 
sample  message  text. 

-  Tell  the  participant  that  they  will  be  listening  for  messages  addressed  to  Yankee 
One. 

4)  Demonstrate  the  use  of  the  data  input  form. 

5)  Play  example  messages  for  eaeh  voice,  one  at  a  time.  Identify  them  by  eall  sign  before 
playing  them. 

6)  Explain  the  general  structure  of  the  experiment. 

-  120  trials  with  overlapping  messages.  60  with  3  voices,  60  with  four. 

-  Some  trials  will  be  spatially  separated  (show  diagrams  on  input  form),  others 

will  not. 

7)  Play  a  three  voice  example  message  without  separation,  then  with  spatial  separation. 

8)  Explain  the  purpose  of  the  inertial  head  traeker  and  demonstrate  its  use  with  the 
message  from  part  7. 

9)  Conduct  10  practice  sessions.  (No  data  eollected,  both  3  and  4  voice) 

10)  Start  experiment 

-  Experimenter  loads  trial  and  announces  whether  it  will  be  spatialized  or  not. 

-  Participant  listens,  listens,  responds  and  indicates  that  they  are  ready  to  proceed 
by 

reading  the  record  number  at  the  bottom  of  the  screen. 


-  The  experimenter  loads  the  next  trial. 
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APPENDIX  I.  LOGIT  REGRESSION  OUTPUT 


This  appendix  contains  the  S-plus  output  for  each  of  the  final  logit  regression  models. 
Every  model  has  a  summary  that  shows  coefficient  estimates  and  an  analysis  of  deviance. 
Highlighted  elements  show  the  response  variable  and  data  set  that  were  used.  The 
following  key  explains  the  abbreviations  that  were  used; 


Speak  =  correct  speaker  identification  (binary  variable) 

Alpha  =  correct  alphabetical  coordinate  identification  (binary  variable) 
Num  =  correct  numerical  coordinate  identification  (binary  variable) 
Agg  =  correct  coordinate  (both  parts)  identification  (binary  variable) 
Ovall  =  three  voice  data 
fdvall  =  four  voice  data 


***  Generalized  linear  Model  *** 

Call:  glm  ( formula  =  [Spealj  ~  Treat  +  Stage  +  Subject  +  Source,  family  = 
binomial,  data  =  |f  3vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.569538  -0.7478461  0.351806  0.71016  2.67143 


Coefficients 

(Intercept ) 
Treat 
Stagel 
Stage2 
Stage3 
Stage4 
Stage5 
stages 
Stage! 
stages 
Stage9 
StagelO 
Stagell 
Sub jectl 
Sub ject2 
Subjects 
Sub ject4 
Subjects 
Subjects 
Subject! 
Subjects 
Subject  9 
Sub jectlO 
Sub jectll 
Sub jectl2 
Sub jectl3 
Sub jectl4 
Sub jectl5 
Subject  1 6 
Sub jectl! 
Sub jectlS 
Subject  1 9 


Value 
0.51483913 
0 .77602143 
-0.28109560 
0.00736669 
0 .04824321 
0.06979610 
-0 . 02202121 
0 . 03470497 
0.01055481 
-0.10481898 
0.10565815 
0.03500396 
0.04980357 
-0.98368493 
0.11370396 
-0.24797918 
0 .01447072 
0.35984256 
0.11819529 
0 .18206240 
0.21013035 
0.15409028 
-0 . 12700250 
0.19844368 
-0 . 13483421 
0.07735733 
-0 . 12681104 
0 . 13436475 
0 . 05871127 
0 . 02414078 
-0 . 12324252 
0 .04122791 


Std.  Error 
0.06853504 
0.08376821 
0.16589010 
0.09225094 
0.06760162 
0.05241986 
0.04398261 
0.03443255 
0.03043267 
0 . 02877001 
0 . 02641267 
0 . 02428357 
0 . 02002787 
0.21937383 
0 . 11880591 
0.09138307 
0 .06503684 
0 .06198609 
0 . 04530685 
0 . 04348514 
0 . 04426841 
0 . 03829152 
0.02902638 
0 . 04097254 
0 . 02552822 
0.02485853 
0.02282596 
0.02853976 
0.02035491 
0 . 01750371 
0.01934308 
0.01648310 


t  value 
7 .5120572 
9.2639127 
-1 . 6944688 
0.0798549 
0.7136398 
1 . 3314819 
-0.5006799 
1 . 0079118 
0 .3468248 
-3.6433425 
4 . 0002835 
1.4414671 
2 .4867130 
-4 .4840577 
0.9570564 
-2 .7136227 
0.2225004 
5 . 8052144 
2 . 6087729 
4 . 1867728 
4 .7467331 
4 . 0241357 
-4 .3754164 
4 . 8433332 
-5.2817711 
3 .1119027 
-5.5555611 
4 .7079847 
2 . 8843784 
1 .3791807 
-6.3713997 
2 .5012233 
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Sub ject20 
Sub ject21 
Sub ject22 
Sub ject23 
Sub ject24 
Sourcel 
Source2 


-0.09097889 
0.06024083 
0.05500250 
-0 . 05641701 
0.03680053 
-0.29099351 
-0 . 52734197 


0 . 01614731 
0.01649920 
0 . 01576402 
0 . 01279552 
0.01337891 
0.09156910 
0.05665785 


-5.6343058 
3.6511374 
3.4891161 
-4 .4091237 
2 .7506371 
-3 .1778571 
-9.3074832 


(Dispersion  Parameter  for  Binomial  family  taken  to  be  1  ) 
Null  Deviance:  2034.146  on  1499  degrees  of  freedom 
Residual  Deviance:  1421.218  on  1461  degrees  of  freedom 
Number  of  Fisher  Scoring  Iterations:  4 

Analysis  of  Deviance  Table 

Binomial  model 


Response:  |SpeaSj  (3  voice) 


NULL 

Treat  1  34.6370 

Stage  11  28.0974 

Subject  24  444.8308 
Source  2  105.3630 


fir, 

St  to  last) 

Df 

Resid . 

Dev 

P 

r  (Ch 

i) 

499 

2034  . 

,146 

498 

1999. 

,509 

0  , 

,000 

00 

00 

04 

487 

1971 , 

,412 

0  , 

,003 

12 

80 

02 

463 

1526, 

,581 

0  , 

,000 

00 

00 

00 

461 

1421 . 

,218 

0  , 

,000 

00 

00 

00 

***  Generalized  linear  Model  *** 


Call:  glm( formula  = 
binomial,  data  =  |f3vall|) 
Deviance  Residuals: 

Min  IQ 

-2.566268  -0.6755575 


Treat  +  Stage  +  Subject  +  Source,  family 


Median  3Q  Max 

-0.1975927  0.6615144  3.235951 


Coefficients : 

(Intercept ) 
Treat 
Stagel 
Stage2 
Stage3 
Stage! 
stages 
Stage6 
Stage! 
stages 
Stage9 
StagelO 
Stagell 
Sub jectl 
Sub ject2 
Subjects 
Subject! 
Subjects 
Subject  6 
Subject! 
Subjects 
Subject  9 
Sub jectlO 


Value 
-0.499155389 
1.263212777 
-0.259662770 
0.185103185 
0 . 022434910 
0.199496485 
-0.005238942 
0.079603400 
0.015658917 
-0.097809063 
0.081708106 
-0 .004421301 
0 .045472721 
-1 . 037291766 
0 . 137001144 
-0.423645895 
0.157889550 
0.298009968 
0.086177557 
0.152941999 
0.238028131 
0 .110452715 
-0.177333609 


Std.  Error 
0.07653958 
0.09485824 
0 .17957489 
0 .09944802 
0 .07309242 
0.05607067 
0.04574889 
0 .03643722 
0 .03275446 
0.02993390 
0 . 02761867 
0.02400394 
0 . 02048126 
0.24537299 
0 . 12994851 
0.12306863 
0.07069623 
0.05735961 
0 .04715274 
0.04087090 
0.03989194 
0.03248956 
0.03823750 


t  value 
-6.5215328 
13.3168482 
-1.4459860 
1.8613058 
0.3069390 
3.5579470 
-0.1145152 
2 . 1846727 
0.4780698 
-3.2675010 
2 . 9584370 
-0 . 1841907 
2.2202111 
-4.2274081 
.  0542725 
.4423550 
.2333518 
.1954673 
.  8276258 
,7420759 
,  9668227 
.3996369 


-4 . 6376878 
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Sub jectll 

0 

Sub jectl2 

-0 

Sub jectl3 

0 

Sub jectl4 

-0 

Sub jectl5 

0 

Sub jectl6 

0 

Sub jectl7 

0 

Sub jectl8 

-0 

Subject  1 9 

0 

Sub ject20 

-0 

Sub ject21 

-0 

Sub ject22 

0 

Sub ject23 

-0 

Sub ject24 

0 

Sourcel 

-0 

Source2 

-0 

173727449 

239601886 

145498598 

179767694 

159908057 

070852939 

032845313 

093698742 

089592642 

147640655 

025582336 

063845149 

083129859 

094421456 

234314454 

425853223 


0  , 

.02 

999249 

0  , 

.04 

751546 

0  , 

.02 

521758 

0  , 

.03 

647320 

0  , 

.02 

409242 

0  , 

.01 

891440 

0  , 

.01 

728108 

0  , 

.02 

105425 

0  , 

.01 

710556 

0  , 

.02 

931237 

0  , 

.01 

488134 

0  , 

.01 

408433 

0  , 

.01 

814655 

0  , 

.01 

480635 

0  , 

.09405247 

0  , 

.06000716 

5.7923650 
-5 . 0426094 
5.7697286 
-4 . 9287613 
6.6372760 
3 .7459783 
1.9006514 
-4.4503480 
5.2376332 
-5.0368038 
-1.7190886 
4.5330627 
-4 .5810294 
6.3770905 
-2 .4913164 
-7 .0967073 


(Dispersion  Parameter  for  Binomial  family  taken  to  be 


1  ) 


Null 

Residual 


Deviance:  2058.269  on  1499  degrees  of  freedom 
Deviance:  1296.23  on  1461  degrees  of  freedom 


Number  of  Fisher  Scoring  Iterations:  5 


Analysis  of  Deviance  Table 

Binomial  model 
Response:  Alpha  (3  voice) 


Terms  added  sequentially  ( 


NULL 

Df 

Deviance 

Resid . 
1 

Treat 

1 

126.9351 

1 

Stage 

11 

20.4466 

1 

Subject 

24 

553.1791 

1 

Source 

2 

61 .4782 

1 

*  *  *  Gene 

r  a  1 

ized  Line 

a  r  Hod 

first 

to  last) 

Df  Resid.  Dev 

Pr (Chi 

499 

2058.269 

498 

1931.334 

0.0000000 

487 

1910.887 

0.0395792 

463 

1357.708 

0.0000000 

461 

1296.230 

0.0000000 

j  1  *  *  * 

Call:  glm(formula  =  Num  ~  Treat  +  Stage  +  Subject  +  Source,  family  =  binomial, 
data  =  |f  3vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.463239  -0.7144343  -0.1357621  0.7214571  3.106442 


Coefficients : 


tercept ) 

-0 

Treat 

0 

Stagel 

-0 

Stage2 

0 

Stage3 

0 

Stage4 

0 

Stage5 

0 

Stage6 

0 

Stage7 

0 

Stage8 

-0 

Stage9 

0 

StagelO 

0 

Stagell 

0 

Sub jectl 

-1 

Value 

403921255 

853645614 

063945583 

179921915 

166318809 

165916765 

025520030 

018728751 

016523652 

051432799 

028128683 

006522976 

048732661 

239805442 


Std.  Error 
0.08491128 
0.08547409 
0.16861896 
0.09533913 
0.06974348 
0.05409936 
0.04465662 
0.03515622 
0.03134518 
0.02955989 
0 . 02641854 
0.02348092 
0.02023034 
0.26351171 


t  value 
-4.7569801 
9.9871859 
-0.3792313 
1.8871780 
2 .3847220 
3.0668898 
0.5714724 
0 . 5327294 
0 . 5271513 
-1 .7399522 
1 .0647328 
0.2777990 
2.4088894 
-4 .7049349 
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Sub ject2 

0 

Subjects 

-0 

Sub ject4 

0 

Subjects 

0 

Subject  6 

0 

Sub ject7 

0 

Subjects 

0 

Subject  9 

0 

Sub jectlO 

-0 

Sub jectll 

0 

Sub jectl2 

-0 

Sub jectl3 

0 

Sub jectl4 

-0 

Sub jectl5 

0 

Sub jectl6 

0 

Sub jectl7 

0 

Sub jectlS 

-0 

Sub jectl9 

0 

Sub ject20 

-0 

Sub ject21 

0 

Sub ject22 

0 

Sub ject23 

-0 

Sub ject24 

0 

Sourcel 

0 

Sources 

-0 

171939992  0 
228341997  0 
180295788  0 
350952206  0 
075618570  0 
155877638  0 
250966248  0 
118192947  0 
193685485  0 
173601877  0 
325374834  0 
127722354  0 
268814691  0 
133828285  0 
068102263  0 
051377075  0 
076138022  0 
087601785  0 
109815382  0 
004598651  0 
068438750  0 
064932167  0 
088521063  0 
020954176  0 
370769939  0 


13075991 

1 , 

.3149289 

10696289 

-2  , 

.1347777 

06692436 

2  , 

. 6940231 

05699136 

6, 

.1579901 

04468605 

1  , 

.  6922188 

03922647 

3, 

.  9737875 

04154623 

6, 

.0406503 

03188838 

3, 

.7064577 

03919961 

-4  , 

.  9410051 

03078794 

5, 

.  6386331 

07468093 

-4  , 

.3568663 

02434595 

5, 

.2461448 

06481189 

-4  , 

.1476137 

02230624 

5, 

.  9995899 

01836822 

3, 

.7076130 

01700326 

3, 

.  0216012 

01998416 

-3, 

.8099192 

01679838 

5, 

.2148951 

02340915 

-4  , 

.  6911310 

01359604 

0  , 

.  3382347 

01401183 

4  , 

.8843546 

01623844 

-3, 

.  9986707 

01463806 

6, 

.0473202 

09161779 

0  , 

.2287130 

05640229 

-6, 

.5736684 

(Dispersion  Parameter  for  Binomial  family  taken  to  be 


1  ) 


Null  Deviance:  2071.945  on  1499 
Residual  Deviance:  1363.367  on  1461 
Number  of  Fisher  Scoring  Iterations 


degrees  of  freedom 
degrees  of  freedom 
5 


Analysis  of  Deviance  Table 

Binomial  model 


Response:  Num  (3  voice) 


Terms  added 

.  sequentially 

(fir, 

St  to  last) 

Df 

Deviance  Resid 

!.  Df 

Resid.  Dev 

Pr (Chi 

NULL 

1499 

2071 . 945 

Treat 

1 

59.9078 

1498 

2012 .037 

0.0000000 

Stage 

11 

19.3649 

1487 

1992 . 672 

0.0548504 

Subject 

24 

583.7778 

1463 

1408 .894 

0.0000000 

Source 

2 

45 . 5271 

1461 

1363.367 

0.0000000 

***  Generalized  Linear  Model  *** 


Call:  glm(formula  =  Agg  ~  Treat  +  Stage  +  Subject  +  Source,  family  =  binomial, 
data  =  |f  3vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.583374  -0.5161874  -0.09603849  0.5794216  3.954573 


Coefficients : 


(Intercept ) 
Treat 
Stagel 
Stage2 


Value 
-1 . 337509044 
1.368148809 
-0.055561464 
0.211627723 


Std.  Error 
0.20599836 
0.10459559 
0 .19424669 
0.10700333 


t  value 
-6.4928140 
13.0803677 
-0.2860356 
1 . 9777677 
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staged 

0 

Stage! 

0 

Staged 

0 

Stage6 

0 

Stage! 

0 

stages 

-0 

Stage9 

0 

StagelO 

0 

Stagell 

0 

Sub jectl 

-1 

Sub ject2 

0 

Subjects 

-0 

Subject! 

0 

Subjects 

0 

Subject  6 

0 

Subject! 

0 

Subjects 

0 

Subject  9 

0 

Sub jectlO 

-0 

Sub jectll 

0 

Sub jectl2 

-0 

Sub jectl3 

0 

Sub jectl! 

-0 

Sub jectl5 

0 

Subject  1 6 

0 

Sub jectl! 

0 

Sub jectlS 

-0 

Sub jectl9 

0 

Sub ject20 

-0 

Sub ject21 

0 

Sub ject22 

0 

Sub ject23 

-0 

Subjects! 

0 

Sourcel 

-0 

Sources 

-0 

051685412 

246444043 

006673028 

046956481 

064338551 

100855992 

095760408 

008644336 

046346353 

735116314 

417885929 

721547551 

350868033 

433507989 

138566306 

253621705 

294892981 

129753500 

342350288 

232658080 

587069736 

216747491 

219055914 

211586804 

124581754 

074949824 

144458591 

127826209 

164822324 

005143384 

095219409 

092411779 

121078751 

182911127 

477302144 


0.08156082 
0.06048497 
0.05060675 
0.03860380 
0.03496131 
0.03266206 
0.03054226 
0.02630459 
0 . 02181777 
0.39966388 
0.16973539 
0.26503305 
0.09138266 
0.06891996 
0 .05562214 
0 .04621862 
0 .04238476 
0.03462833 
0.09398121 
0 .03196711 
0 . 33449107 
0.03551718 
0 .07179255 
0.03024594 
0.02557960 
0 . 02313327 
0.04139968 
0.02090685 
0.05009207 
0.01856959 
0.01691461 
0 . 02720949 
0.01643286 
0.10188991 
0.06588310 


0.6337039 
4 . 0744673 
0.1318604 
1.2163693 
1 . 8402785 
-3.0878639 
3.1353416 
0.3286246 
2 . 1242481 
-4.3414389 
2 .4619847 
-2 . 7224814 
3.8395471 
6.2900206 
2 .4912077 
5.4874360 
6.9575247 
3 .7470334 
-3 . 6427525 
7.2780462 
-1 .7551133 
6.1026092 
-3.0512346 
6.9955440 
4 . 8703551 
3.2399153 
-3.4893650 
6.1140816 
-3.2903877 
0.2769788 
5.6294190 
-3.3963073 
7.3680884 
-1 .7951840 
-7.2446829 


(Dispersion  Parameter  for 


Binomial  family  taken  to  be 


1  ) 


Null 

Residual 


Deviance:  2005.347  on  1499  degrees  of  freedom 
Deviance:  1107.34  on  1461  degrees  of  freedom 


Number  of  Fisher  Scoring  Iterations:  7 

Analysis  of  Deviance  Table 

Binomial  model 


Response:  Agg  (3  voice) 


Terms  added 

1  sequentially 

(first 

to  last) 

Df 

Deviance  Resid 

!.  Df  Resid.  Dev 

Pr  (Chi) 

NULL 

1499 

2005.347 

Treat 

1 

113.9209 

1498 

1891 . 426 

0.00000000 

Stage 

11 

17.7211 

1487 

1873.705 

0.08828136 

Subject 

24 

704 .3137 

1463 

1169.391 

0.00000000 

Source 

2 

62.0513 

1461 

1107.340 

0.00000000 

***  Generalized  Linear  Model  *** 

Call:  glm( formula  =  ^otal]  ~  Treat  +  Stage  +  Subject  +  Source,  family 
binomial,  data  =  |f  3vall[) 

Deviance  Residuals: 
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Min  IQ  Median  3Q  Max 

-2.552273  -0.49411  -0.008970102  0.5480952  3.548353 


Coefficients : 


(Intercept ) 

-2 

Treat 

1 

Stagel 

0 

Stage2 

0 

Stage3 

0 

Stage4 

0 

Staged 

0 

Stage6 

0 

Stage! 

0 

stages 

-0 

Stage9 

0 

StagelO 

0 

Stagell 

0 

Sub jectl 

-5 

Sub ject2 

1 

Subjects 

-1 

Sub ject4 

1 

Subjects 

0 

Subject  6 

0 

Subject! 

0 

Subjects 

0 

Subject  9 

0 

Sub jectlO 

-0 

Sub jectll 

0 

Sub jectl2 

-0 

Sub jectl3 

0 

Sub jectl4 

-0 

Sub jectl5 

0 

Subject  1 6 

0 

Sub jectl! 

0 

Sub jectlS 

-0 

Sub jectl9 

0 

Sub ject20 

-0 

Sub ject21 

0 

Sub ject22 

0 

Sub ject23 

-0 

Sub ject24 

0 

Sourcel 

-0 

Source! 

-0 

Value 

578798794 

449144223 

007968436 

234342267 

045824336 

246457805 

031543198 

059956522 

058702616 

088977696 

125969527 

001552376 

059785057 

028818120 

505176148 

633498567 

011640367 

848717648 

442476101 

486893906 

466009276 

284820896 

767368536 

387632845 

620101400 

332665060 

120540370 

307232697 

207103261 

147197741 

123636783 

179480634 

398605669 

066469947 

153958515 

092781897 

151381891 

232218954 

526318062 


Std.  Error 
1 .05124187 
0 .11015470 
0.20181965 
0.10996509 
0.08607050 
0.06205051 
0.05311618 
0.03929985 
0 .03572191 
0.03378668 
0.03252690 
0 . 02715262 
0 .02229459 
5.85566746 
1 . 95493803 
3.08526961 
0.83056404 
0.55465420 
0.39710396 
0.29848257 
0.23313753 
0.18676361 
1 .07490029 
0.15654385 
0 . 90989645 
0 .13102926 
0 .13087227 
0.10040632 
0.08824325 
0.07855167 
0.08730639 
0.06391869 
0.56027865 
0.05880971 
0.05370186 
0.06393137 
0.04572986 
0.10553896 
0.06949406 


t  value 
-2 .45309748 
13.15553693 
0.03948295 
2.13106058 
0 .53240464 
3.97188992 
0.59385287 
1 . 52561710 
1.64332256 
-2 . 63351401 
3 . 87277955 
0 . 05717222 
2 . 68159479 
-0.85879503 
0.76993548 
-0.52945083 
1.21801609 
1 .53017438 
1.11425758 
1.63123063 
1.99885998 
1 . 52503421 
-0 .71389741 
2 .47619344 
-0.68150766 
2.53886078 
-0.92105357 
3.05989398 
2.34695862 
1.87389693 
-1 .41612518 
2 . 80795213 
-0 .71144184 
1 . 13025461 
2 .86691217 
-1 .45127346 
3.31035125 
-2.20031501 
-7.57356916 


(Dispersion  Parameter  for  Binomial  family  taken  to  be 


1  ) 


Null  Deviance:  1980.035  on  1499 


Residual  Deviance:  1030.291  on  1461 


degrees  of  freedom 
degrees  of  freedom 


Number  of  Fisher  Scoring  Iterations:  9 


Analysis  of  Deviance  Table 

Binomial  model 

Response:  [Tot all 

Terms  added  sequentially  ( 
Df  Deviance  Resid. 
NULL  1 

Treat  1  118.4673  1 


first 

to  1 

ast ) 

D  f  Re  s i  d . 

Dev 

Pr  (Chi 

499 

1980 

.035 

498 

1861 

.567  0, 

.0000000 

no 


stage  11  19.7659 

Subject  24  739.9690 
Source  2  71.5412 


1487 

1463 

1461 


1841.801  0.04865615 
1101.832  0.00000000 
1030.291  0.00000000 


***  Generalized  Linear  Model  *** 


Call:  glm( formula  =  [Spealj  ~  Treat  +  Stage  +  Subject  +  Source,  family 
binomial,  data  =  |f  4vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.174215  -0.8338993  -0.4509354  0.8719862  2.588626 


Coefficients : 


Intercept ) 

-0 

Treat 

0 

Stagel 

0 

Stage2 

0 

Staged 

0 

Stage4 

-0 

Staged 

0 

Stage6 

-0 

Stage! 

0 

Staged 

0 

Stage9 

0 

StagelO 

0 

Stagell 

0 

Sub jectl 

-0 

Sub ject2 

0 

Subjects 

-0 

Sub ject4 

0 

Subjects 

0 

Subject  6 

0 

Subject! 

0 

Subjects 

0 

Subject  9 

0 

Sub jectlO 

-0 

Sub jectll 

0 

Sub jectl2 

-0 

Sub jectl3 

0 

Sub jectl4 

-0 

Sub jectl5 

0 

Sub jectl6 

0 

Sub jectl! 

0 

Sub jectl8 

-0 

Subject  1 9 

0 

Sub ject20 

-0 

Sub ject21 

0 

Sub ject22 

0 

Sub ject23 

-0 

Sub ject24 

0 

Sourcel 

-1 

Source2 

-0 

Sourced 

-0 

Value 

451522032 

596539304 

046790786 

103198411 

044980362 

052857045 

024816547 

025831559 

039225145 

068557955 

019916461 

020687407 

043170842 

705798767 

116324956 

238291108 

017581331 

135030598 

032236297 

166110976 

100677833 

011037067 

016267702 

125676961 

079369155 

060689982 

052107516 

047235189 

026596324 

056943676 

023422260 

067294017 

014175124 

038725797 

031625403 

044732428 

009085493 

237949591 

161965178 

249152959 


Std.  Error 
0.06334102 
0.06759594 
0.15254361 
0.09666732 
0.06383973 
0.05156064 
0.04285539 
0.03594567 
0.03046676 
0.02600499 
0.02139056 
0.01951456 
0.01845950 
0.23217582 
0 . 12713202 
0.10287505 
0.07155458 
0.05506644 
0.04759825 
0.03989017 
0.03484805 
0.03183511 
0 . 02951022 
0.02651850 
0 . 02770400 
0.02183315 
0 . 02293140 
0.01897828 
0.01785580 
0 .01694425 
0 .01691734 
0.01558715 
0.01493859 
0.01371860 
0.01306585 
0 .01445799 
0.01203031 
0.10004557 
0.05603400 
0 .04042451 


t  value 
-7 . 1284298 
8.8250765 
0.3067371 
1.0675625 
0.7045826 
-1 . 0251433 
0.5790765 
-0 .7186279 
1 .2874735 
2.6363387 
0.9310863 
1.0601010 
2 .3386787 
-3.0399322 
0 . 9149934 
-2.3163159 
0.2457052 
2.4521396 
0.6772580 
4 .1642080 
2.8890520 
0.3466948 
-0.5512565 
4 . 7392183 
-2 .8648992 
2 .7797173 
-2.2723221 
2 .4889074 
1.4895060 
3.3606492 
-1 .3845121 
4 .3172748 
-0.9488929 
2 . 8228674 
2 .4204634 
-3.0939583 
0 .7552171 
■12.3738566 
-2.8904806 
-6.1634130 


(Dispersion  Parameter  for  Binomial  family  taken  to  be 


1  ) 


Null  Deviance:  2036.904  on  1499  degrees  of  freedom 
Residual  Deviance:  1584.855  on  1460  degrees  of  freedom 
Number  of  Fisher  Scoring  Iterations:  4 
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Analysis  of  Deviance  Table 


Binomial  model 


Response:  [SpeaSj  (4  voice) 


Terms  added 
Df 

NULL 
Treat  1 
Stage  11 
Subject  24 
Source  3 


sequent! 

ally  (first 

to  1 

ast ) 

Deviance 

Re  s  i  d .  D  f  Re  s  i  d . 

Dev 

Pr  (Chi) 

1499 

2036 

.  904 

60. 

.5642 

1498 

1976 

.340 

0 

.0000000 

13. 

.1459 

1487 

1963 

.194 

0 

.2838985 

129. 

.6921 

1463 

1833 

.502 

0 

.0000000 

248. 

.  6474 

1460 

1584 

.855 

0 

.0000000 

***  Generalized  Linear  Model  *** 


Call:  glm( formula  =  ftlphj  ~  Treat  +  Stage  +  Subject  +  Source,  family 
binomial,  data  =  |f  4vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.415434  -0.6853618  -0.3211171  0.6586104  3.186737 


Coefficients 

(Intercept ) 
Treat 
Stagel 
Stage2 
Stage3 
Stage4 
Stage5 
Stage6 
Stage7 
stages 
stages 
StagelO 
Stagell 
Sub jectl 
Sub ject2 
Subjects 
Sub ject4 
Subjects 
Subject  6 
Subjects 
Subjects 
Subject  9 
Sub jectlO 
Sub jectll 
Sub jectl2 
Sub jectl3 
Sub jectl4 
Sub jectl5 
Sub jectl6 
Sub jectl7 
Sub jectlS 
Subject  1 9 
Sub ject20 
Sub ject21 
Sub ject22 


Value 
-1.21083479 
0.87971146 
0 . 53821021 
0 . 18178974 
-0.08530765 
-0.03691810 
-0.03093163 
-0.01614141 
0 .01028119 
0.00436431 
0.03251150 
0.02637611 
0.03582885 
-1.25335229 
-0 . 03249213 
-0.20486068 
0 . 18498413 
0 . 12332275 
0 . 02754282 
0 . 15556211 
0 .17962521 
0.09093095 
-0.16163340 
0 .16275259 
-0.23967573 
0 .08184291 
-0 .14294851 
0.07543165 
0 . 03427347 
0.07560662 
-0.13338521 
0.10195666 
-0.05860815 
0.01669726 
0.05144368 


Std.  Error 
0 . 08412740 
0.07952530 
0 .16575572 
0.10034706 
0 . 07655722 
0.05654307 
0 . 04749748 
0.03770636 
0.03408855 
0.02953251 
0.02334651 
0 . 02161193 
0 . 02248443 
0.28290880 
0 . 15184138 
0.12008960 
0 . 07479669 
0 . 05997757 
0 . 05268427 
0 . 04139049 
0 . 03613366 
0 . 03219855 
0 . 04447131 
0 . 02711363 
0.05785558 
0 . 02279492 
0.03794390 
0.01983208 
0.01915100 
0 . 01740287 
0 . 03349237 
0 . 01603721 
0 . 02077423 
0 . 01493071 
0.01349886 


t  value 
-14 .3928706 
11 .0620324 
3.2470084 
1.8116100 
-1 .1142992 
-0 . 6529199 
-0 . 6512268 
-0 .4280820 
0.3016025 
0 .1477799 
1.3925633 
1.2204422 
1.5934961 
-4 .4302343 
-0.2139873 
-1.7058986 
2 .4731594 
2 .0561477 
0 . 5227901 
3.7584019 
4 . 9711325 
2 . 8240701 
-3.6345545 
6.0026123 
-4 .1426557 
3.5904021 
-3.7673652 
3.8035173 
1 .7896441 
4 . 3444904 
-3.9825555 
6.3575055 
-2.8211943 
1 .1183164 
3.8109642 
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Sub ject23 
Sub ject24 
Sourcel 
Source2 
Sources 


.07843082 
. 03411228 
.86024001 
.47311406 
.26688955 


0.02158876 
0.01255355 
0 . 10481379 
0.06580858 
0 . 04617661 


-3 . 6329479 
2 .7173411 
-8.2073170 
-7 .1892462 
-5 .7797557 


-0 

0 

-0 

-0 

-0 


(Dispersion  Parameter  for 


Binomial 


family  taken  to  be  1  ) 


Null  Deviance:  1885.103  on  1499  degrees  of  freedom 
Residual  Deviance:  1298.966  on  1460  degrees  of  freedom 
Number  of  Fisher  Scoring  Iterations:  5 
Analysis  of  Deviance  Table 
Binomial  model 
Response:  Alpha  (4  voice) 


Terms  added  sequentially  (first  to  last) 

Df  Deviance  Resid.  Df  Resid.  Dev  Pr(Chi) 

NULL  1499  1885.103 

Treat  1  86.4979  1498  1798.606  0.0000000000 

Stage  11  32.4806  1487  1766.125  0.0006383718 

Subject  24  290.4680  1463  1475.657  0.0000000000 

Source  3  176.6913  1460  1298.966  0.0000000000 

***  Generalized  Linear  Model  *** 

Call:  glm(formula  =  Num  ~  Treat  +  Stage  +  Subject  +  Source,  family  =  binomial, 
data  =  |f  4vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.361954  -0.7654238  -0.4178939  0.7764193  3.352208 


Coefficients 

(Intercept ) 
Treat 
Stagel 
Stage2 
Stage3 
Stage4 
Stage5 
Stage6 
Stage! 
stages 
Stage9 
StagelO 
Stagell 
Sub jectl 
Sub ject2 
Subjects 
Sub ject4 
Subjects 
Subject  6 
Subject! 
Subjects 
Subject  9 
Sub jectlO 
Sub jectll 
Sub jectl2 


Value 
-1 .107489943 
0 .708496142 
0.087651931 
0.098181454 
-0.029590594 
-0.039036937 
0.009934514 
-0.034914637 
0.066620013 
0.039036365 
-0.006851529 
0.018561154 
0.017340581 
-1.085401763 
-0.001166630 
-0 .319744911 
0.104539952 
0.085943817 
0.033064399 
0 . 127185625 
0.144361680 
0.082897391 
-0 . 122043917 
0 .147122152 
-0.105197025 


Std.  Error 
0.07979440 
0.07329501 
0 .15777088 
0.09619160 
0.07280296 
0.05297006 
0.04357384 
0.03634385 
0 .03111047 
0 . 02776794 
0.02303643 
0 . 02091184 
0 . 02118342 
0.25874217 
0.13860607 
0 . 12487995 
0.07359576 
0.05852213 
0.05032315 
0.03991255 
0.03455089 
0.03095775 
0.04019992 
0.02585674 
0.03387973 


t  value 
■13 . 879293327 
9.666362160 
0.555564712 
1.020686409 
-0 .406447685 
-0.736962262 
0.227992624 
-0.960675243 
2.141401676 
1.405807256 
-0.297421465 
0.887590672 
0.818592170 
-4.194916400 
-0.008416878 
-2.560418243 
1 .420461561 
1.468569619 
0 . 657041542 
3.186607311 
4 . 178233437 
2 . 677759083 
-3.035923999 
5.689895016 
-3.105014065 
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Sub jectl3 
Sub jectl4 
Sub jectlS 
Subject  1 6 
Sub jectl7 
Sub jectlS 
Sub jectl9 
Sub ject20 
Sub ject21 
Sub ject22 
Sub ject23 
Sub ject24 
Sourcel 
Source2 
Sources 


064888516 

101466488 

079339876 

020968578 

078452384 

189062540 

084352635 

053616244 

014787695 

043105199 

034453703 

012075604 

625502077 

354759491 

285285899 


0 . 02162705 
0.03105635 
0.01873632 
0.01829584 
0 .01662924 
0.05116179 
0 .01522373 
0.01985526 
0 .01427340 
0.01296045 
0.01597236 
0 .01248277 
0.09634615 
0.06109698 
0.04525864 


0. 

-0. 

0. 

0. 

0. 

-0. 

0. 

-0. 

0. 

0. 

-0. 

0. 

-0. 

-0. 

-0. 


3.000341119 
-3 .267173324 
4 .234549372 
1 . 146084246 
4 .717736035 
-3.695385686 
5.540863302 
-2 .700354340 
1.036031406 
3 . 325902743 
-2 . 157083229 
0.967381458 
-6.492237181 
-5.806498392 
-6.303456859 


(Dispersion  Parameter 


for  Binomial  family  taken  to  be  1  ) 


Null  Deviance:  1880.608  on  1499  degrees  of  freedom 
Residual  Deviance:  1424.494  on  1460  degrees  of  freedom 
Number  of  Fisher  Scoring  Iterations:  5 

Analysis  of  Deviance  Table 

Binomial  model 


Response:  Num  (4  voice) 


Terms  added  sequentially  ( 


NULL 

Df 

Deviance 

Resid . 
1 

Treat 

1 

64.2700 

1 

Stage 

11 

16.1308 

1 

Subject 

24 

242.0624 

1 

Source 

3 

133.6512 

1 

first 

to  last) 

D  f  Re  s i  d . 

Dev 

Pr  (Ch 

i) 

499 

1880  . 

,  608 

498 

1816. 

,338 

0 

.00000 

00 

487 

1800  . 

,208 

0 

.13634 

46 

463 

1558  , 

,145 

0 

.00000 

00 

460 

1424  , 

,494 

0 

.00000 

00 

***  Generalized  Linear  Model  *** 


Call:  glm(formula  =  Agg  ~  Treat  +  Stage  +  Subject  +  Source,  family  =  binomial, 
data  =  |f  4vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-2.724998  -0.556848  -0.1961331  0.2451993  3.608104 


Coefficients 

(Intercept ) 
Treat 
Stagel 
Stage2 
stages 
Stage4 
stages 
Stage6 
Stage! 
stages 
Stage9 
StagelO 
Stagell 
Sub jectl 
Subjects 


Value 
-2.484958595 
1 .171229710 
0 .373484407 
0.168745928 
-0.030587399 
-0.038330297 
-0.001666578 
-0 . 073917176 
0 .045707970 
0 . 021721850 
-0.002905869 
0 . 024988119 
0.026313433 
-1.483615609 
0.197758670 


Std.  E 

rror 

0  , 

.4071 

6860 

0  , 

.0967 

7191 

0  , 

.1854 

7321 

0  , 

.1181 

6900 

0  , 

.0853 

1868 

0  , 

.0668 

9854 

0  , 

.0557 

6482 

0  , 

.0454 

1962 

0  , 

.03867629 

0  , 

.03295997 

0  , 

.0254 

9042 

0  , 

.02363664 

0  , 

.0268 

1421 

0  , 

.36838841 

0, 

.1773 

1542 

t  value 
-6.10302122 
12 . 10299242 
2.01368389 
1 .42800498 
-0.35850765 
-0 .57296164 
-0.02988584 
-1 . 62742844 
1 . 18180846 
0.65903740 
-0 . 11399844 
1 . 05717714 
0 . 98132411 
-4 . 02731343 
1 . 11529313 
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Sub ject3 

-0 

Sub ject4 

0 

Subjects 

0 

Subject  6 

0 

Sub ject7 

0 

Subjects 

0 

Subject  9 

0 

Sub jectlO 

-0 

Sub jectll 

0 

Sub jectl2 

-0 

Sub jectl3 

0 

Sub jectl4 

-0 

Sub jectl5 

0 

Sub jectl6 

0 

Sub jectl7 

0 

Sub jectl8 

-0 

Subject  1 9 

0 

Sub ject20 

-0 

Sub ject21 

0 

Sub ject22 

0 

Sub ject23 

-0 

Sub ject24 

0 

Sourcel 

-1 

Source2 

-0 

Sources 

-0 

737225357 

334657232 

262617625 

117010365 

229125316 

200191471 

076676097 

311995834 

201328296 

635459279 

162213035 

138040192 

140425603 

094158369 

122586832 

421413421 

144507016 

054798911 

027679685 

095376716 

119105087 

055304882 

026235146 

548370288 

319874612 


0.27012335 
0.09735634 
0 .07323822 
0 .06243207 
0.04799032 
0 .04101733 
0.03796120 
0.09623291 
0.03019758 
0 . 52967842 
0 .04537294 
0 .06159412 
0.03599206 
0.03275058 
0.02939736 
0.36292755 
0 .03071246 
0.03649952 
0 . 02788716 
0 . 02412245 
0.04720699 
0.02159563 
0 . 12391973 
0.07550067 
0.05394976 


-2 . 72921744 
3 .43744667 
3.58580027 
1 . 87420287 
4 .77440693 
4 . 88065571 
2 . 01985432 
-3.24209090 
6.66703432 
-1 .19970771 
3.57510517 
-2.24112625 
3 . 90157184 
2 . 87501403 
4 .16999447 
-1 .16115027 
4.70515986 
-1.50135970 
0.99256010 
3.95385705 
-2.52303898 
2.56092925 
-8 .28145064 
-7.26311827 
-5.92912039 


(Dispersion  Parameter  for  Binomial  family  taken  to  be 


1  ) 


Null  Deviance:  1697.903  on  1499 
Residual  Deviance:  1027.397  on  1460 
Number  of  Fisher  Scoring  Iterations 


degrees  of  freedom 
degrees  of  freedom 
8 


Analysis  of  Deviance  Table 

Binomial  model 


Response:  Agg  (4  voice) 


Terms  added  sequentially  ( 


Df 

Deviance 

Resid . 

NULL 

1 

Treat 

1 

117 . 8323 

1 

stage 

11 

19.8053 

1 

Subject 

24 

341.1622 

1 

Source 

3 

191.7060 

1 

first 

to  last) 

D  f  Re  s i  d . 

Dev 

Pr 

(Chi) 

499 

1697  . 

,  903 

498 

1580  , 

,071 

0  , 

.000 

00000 

487 

1560  , 

,265 

0  , 

.048 

08285 

463 

1219  . 

,103 

0  , 

.000 

00000 

460 

1027  . 

,397 

0  , 

.000 

00000 

***  Generalized  Linear  Model  *** 

Call:  glm( formula  =  ~  Treat  +  Stage  +  Subject  +  Source,  family 

binomial,  data  =  |f  4vall|) 

Deviance  Residuals: 

Min  IQ  Median  3Q  Max 

-3.077598  -0.4361802  -0.1159388  -0.001087361  3.935196 


Coefficients 

(Intercept ) 
Treat 
Stagel 
Stage2 
Stage3 


Value 
-3 .819044962 
1 . 640541996 
-0.096984735 
0.329837526 
0 .009840141 


Std.  Error 
0 . 98159357 
0 . 12773694 
0.20823264 
0 .14176421 
0.09414000 


t  value 
-3.89065808 
12 . 84312924 
-0.46575183 
2.32666295 
0 . 10452667 
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stage! 

-0 

Staged 

0 

Stage6 

-0 

Stage! 

0 

stages 

0 

Stage9 

0 

StagelO 

0 

Stagell 

0 

Sub jectl 

-4 

Sub ject2 

1 

Subjects 

-1 

Subject! 

0 

Subjects 

0 

Subject  6 

0 

Subject! 

0 

Subjects 

0 

Subject  9 

0 

Sub jectlO 

-0 

Sub jectll 

0 

Sub jectl2 

-0 

Sub jectl3 

0 

Sub jectl! 

-0 

Sub jectl5 

0 

Sub jectl6 

0 

Sub jectl! 

0 

Sub jectlS 

-0 

Sub jectl9 

0 

Sub ject20 

-0 

Sub ject21 

0 

Sub ject22 

0 

Sub ject23 

-0 

Subjects! 

0 

Sourcel 

-1 

Sources 

-0 

Sources 

-0 

090205199  0 
006028347  0 
016924547  0 
064291724  0 
047293715  0 
012025645  0 
016648898  0 
030825472  0 
893133244  5 
576213233  1 
617336619  2 
986851326  0 
708106016  0 
484862519  0 
520985283  0 
392571516  0 
228165181  0 
207372316  0 
335617734  0 
638599778  0 
260678437  0 
080911141  0 
216858177  0 
164389644  0 
158985900  0 
441220966  0 
202580740  0 
042987825  0 
061099965  0 
132045292  0 
345613148  0 
091117437  0 
335980784  0 
612389828  0 
423900862  0 


08126436 

-1 

06814331 

0 

05120087 

-0 

04424727 

1 

03650413 

1 

02683522 

0 

02536911 

0 

03115532 

0 

43769170 

-0 

81772560 

0 

86410503 

-0 

77328548 

1 

51684419 

1 

37067579 

1 

27833078 

1 

21729892 

1 

17512215 

1 

17053132 

-1 

12071868 

2 

84180487 

-0 

10668831 

2 

10457739 

-0 

08171355 

2 

07250809 

2 

06472364 

2 

57464168 

-0 

06011713 

3 

06138225 

-0 

05109311 

1 

04569332 

2 

45453504 

-0 

04331215 

2 

15037519 

-8 

08689292 

-7 

06317990 

-6 

11002164 

08846572 

33055193 

45300990 

29557162 

44812915 

65626651 

98941276 

89985485 

86713486 

56469180 

27617983 

37005702 

30805013 

87182062 

80659671 

30289160 

21603657 

78016400 

75860784 

44336455 

77369632 

65388278 

26719048 

45638056 

76781929 

36976739 

70032991 

19585527 

88981597 

76036634 

10373853 

88431634 

04763771 

70942577 


(Dispersion  Parameter  for  Binomial  family  taken  to  be 


1  ) 


Null  Deviance:  1612.981  on  1499 
Residual  Deviance:  844.5036  on  1460 
Number  of  Fisher  Scoring  Iterations 


degrees  of  freedom 
degrees  of  freedom 
9 


Analysis  of  Deviance  Table 

Binomial  model 
Response:  |lotal| 


Terms  added  sequentially  ( 


Df 

Deviance 

Resid . 

NULL 

1 

Treat 

1 

157 .4023 

1 

Stage 

11 

20 . 1265 

1 

Subject 

24 

357 .3420 

1 

Source 

3 

233.6063 

1 

first 

to  last) 

D  f  Re  s i  d . 

Dev 

Pr 

(Chi) 

499 

1612  . 

,  981 

498 

1455. 

,578 

0  , 

,000 

00000 

487 

1435, 

,452 

0  , 

,04363533 

463 

1078  , 

,110 

0  , 

,000 

00000 

460 

844  . 

,504 

0  , 

,000 

00000 
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